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Two fundamental components of the decisionmaking process are 
the acquisition of new knowledge and the retrieval of Icnowledge ^rom 
memory. The knowledge available to a decisionmaker is frequently 
expressed in textual idocuments that are voluminous and poorly 
organized. Decisionmakers in command and control situations, both 
-rTrr*«Qtly and in the future, \^ill become increasingly dependent on 
textual knowledge baSes t)iat are resident in computers. The quality 
of decisions' .will undoubtedly depend on the quality of the 
information available t'o the decisionmaker. Thus it is important to 
optimize both t^e amount of information he can assimilate from \a text 
and h-is ability \o retrieve that information when needed. To 'improve > 
'^hia ability to retain and use acquired knowledge, it is necessary to 
understand the relationship tetween the information presented in 
texts and the representatioh of knowledge. in human memory. It should 
be possible to adapt the format of the presented text to facilitate 
•the reader's assimilation and utilization of the information. This 
might be accomplished by filtering and reorganizi^^g the to-be-learned 
•material. Developing technologies in .'electronic data bases and 
computer-controlled communicatioiis make this filtering process a real 
possibility for decisionmakers who routinely receive information 
.on-line.; f V , 

This repart details the results of a one-year study, completed 
in Novembe.r 1977, supported by the Cybernetics Technology Office 
(CTO) of the defense Advanced Research Brojects Agency (ARPA). The 
findings, shich were provided to ARPA -at that time in informal 
'documentation, have feeen prepared here in report form, using* Rand 
Corporation funds., for distribution to a wider audience* 

The objective of the research was to develop moidels of how 
humans store, organ ixe, and retrieve in memory.. inf,onnation obtained 
fj2m\ reading .texts', * Th&se ^models , derived empirically from a * series 
of psychological experiments, might serve as the basis- for the design 
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of computer systems capable of structuring and presenting texts in > 
optimal formats. A system incorporating such pi acipl«s of human 
learning into its text-handling facilifties would prove to be a useful 
mury aid for military commanders, intelligence analysts, or other 
high- Ipvel . decisionmakers who depend on large computeir data' bases of 
knowledge.* The research reported here has been directed toward the * 
deve^^opraent of iiTunan information processing •'models tather than a 
•dem'ohstrable dompufeer system. However, the results of this study may 
^Save direct applrcability to tKe cpnstructfon of a system 
incorporating tec^iques for formatting texts into optimal 
organizations. 




SUMMARY 
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This report documents* a series of studies of how people learn 

t. . . ' » 

•from and reason with information contained in^ texts ♦ The experiments 
reported hevfe are based 6n ^he premise tkat readers "typicalxy derive 
their^ knowledge from several source texts/ The rieader's problem, 
then, is, not only to acquire individual facts but to ^organize .related 
facts obtained from diverse sources* 

The research has been motivated by four goals: (1) to elucidate 
the proqess . by which knowledge Is acquiy^d from a textual document; 

(2) to specify how the acquired knowledge is represented in memory, 

(3) to identify how and when related information is ^integrated in 
memary, and (4) .to discover" techniques, for the facilitation of 
leatning ^nU reasoninj^' with textual* information. Two task domains 
were chosen iti whicii to atudy the strucCures and processes uuderlyin,^ 
hi^m^an performance^ with texts: T^ ^irst- task domain was simj 
ACQUISITION, in which the teader attempted to learn and retain^a^iriuch 
knowledge from the text as possible. The second task ^,/domain was 
♦INFERENTIAL REASONING, in which the reaBar had to ar^nize /a set of 
facts fromvthe text in order to generate, or, J^«ify ^ condjusion 
following from the facts* 'For bofh d6mkins^^^>Ke v^^^j^ 
model the representation of knowledge^in memory- and the excesses 



required 'to perform the task, and -dfelten to design text^^resentation 
formats that ^fac^ilitated Ixsth th? transfer ofjtam^/ledge from texts 
into these mealfory structures and the ^performance of inferential 
reasoning tasks. 



Five se^s of studies evaluated particular -processing models and 

optimization techniques. In Study 1, the acquisition of new •knowledge 

« 

that conformed to^a- previously learned structure, or schema, ik^s^ 
investigated. Memory for te^tt information was generally facilitated 
by prior traiining with the structure in whj.ch the' text was embedded, 
particularly when there was no confusion among .facts from different 
texts sharing a common organization. ^ ^ 



■ ■ \ 

In Study.2,Vnfonnati 
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Ion from newsj^aper stories was resti^uctured 
into different formats in an attempt;, to improve' memory for the 
stories, ^bese formats included a condensed version of the news story 
(with all redundant and ^superfluous informatioi).-tJeleted) , a narrative 
structure baaed on the temporal order of evAts, a topical^ structure 
organized* accotding to the primary concepts of the passa^ge^ and an 
outli^ne structure t^at reduced^ the/ text to key phrases spatially 
arranged on the page in outline form* ' AlT forms of restructuring 
produced significant improvements in recall of the . information 
contained in the passage. . 

Stud^^ investigated the integration of related but sepfr-rately 
•acquired facts in memory either for apprehension of a complex idea 
i(*r performing inferential reasoning. Integration of separate^Wcts 
into a unified memory structure was more likely to occu^^irealated 
facts occurred in close temporal proximity and if theUk^^zs cued each 
other With •similar wordings, rather than with.,^ptraphrased wording 
The integration* of facts significantly impreVed^the ability to^^fedill 
related information and perform synergistic reasoning. 

Technrque^. for Improving a learner*^ ability to organize diverse 
information for . inferencing were investigated in Studies 4 and 5* In 
Study subjects verified inferences based on information from two 
distinct texts. Performance was better when subjects had attempted to 
commit the texts to memory than when they were allowed to inspect t^e 
texts freely during the' reasoning test. In Study; 5, methods of 
annotating texts to facilitate integration and inferencing were 
investigated. ' - 

The results from these studies are presented in (the context of 
set of models for ^knowledge representation an^l processing. Based on' 
these models and the obtained experimental results, \ set of 
principles for improving human learning from "texts emerged. To the 
extent that our subject and materials samples were representative of 4 
the population of readers and potential texts, these principles a*re 
descriptive of human text-processing characteristics. ' They may be 
summarized as follows: 

•7 
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1« Presentation of new information in well^learned structural 
.organizations car) .facilitate learning of the new'inforipat;ion* 

2. Presentation in close temporal proximity of large numbers of 
f .facts (i«e«> five or more)^ sharing a common structural 

framework interferes with learning, 

3. Temporal separation in presentation of interfering facts can, 
lim^'t interfering effects. ' 

A. Eliminartlon o( redundant and irrelev^t commentary from 
newspaper stories facilitates assimilation ai^d retention of 
im^prt^nt facts. 

5. Text organizations that place complementary facts in close 
proximity improve integration Qf those facts. 

6. V/ording complemen;^ary texts as similarly as possible improves 



integration of cdmplementary facts that occur in separate 
texts. ♦ ^ . ' * ^ 

7. Wcrding related texts as similarly as possible improves 
inferential reasoning based on faf,t.s* within the texXs. 

8. Reasoning from memory ^bout carefully studied texts /is - more 
y accurate than reasoning based on inspection of less fami^ii^r. 

texts. * ' . ^ / * . / 

9. Knowledge of t^ie information contained in texts is improved 
,by studying to learn the texts rather than using the texts to 
perform ^nferenclng. • . - , - 

10 Annotating texts with, re^rences -^o related facts that^^ have 
occurred in previous texts facilitates general inferential 



'reasoning from the texts. 
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I.. INTRODUCTION 



An infornation glut confronts most decisionmakers. The 
information they must assimilate from .textual documents is typical.lj 
voluminous, poorly organized and presented,* and informational ly 
sparse. It is often necessary to make rapid decisions based on an 
overload of available information, and the decisionmaker can rarefy 
invest the time necessary to rehearse the new. material , integrate the 
I new facts with existing knowledge, or otherwise, improve his memory for 
\the information. Presumably, the quality *of decisions depend^ on thfe 
quality of the information that is utilized ^i^arriving at those 
decisions. Therefore; optimizing a decisionmaker's ability to acquire 
ai\d use information nwould have beneficial consequences for th'e* 
decisionmaking process. * ♦ 

Th? objective of the jjesef rch reported here was to dev^ lop models 
-of how pepple store, organize, and retrieve in memory information- 
obtained from reading texts. Throughout the course of the research, 
it was assumed that to improve the decisionmaker's acquisition and use 
of information it is necessary to understand tho relationship .between 
the information presented itk texts and the rei^resentation of knowledge 
in huinan memory. Information is most readily assimilated when it is 
structured in a format that matches human cognitive structures and 
presented in a way that strengths as and maintains* its memory 
representation. If a determination of human memory structures arid 
processing strategj^es can be made, then it should be possible to adapt 
the ^format of presented texts to match these structures and hence 
facilitate the reader's assimilation and utilization of the 
information- In a real-world situation, this text formatting might be 
accomplished by filtering and reorganizing the to-be-learned material 
before it is presented to the decisionmaker, or by reqursting <the 
decisionmaker to process the information in the text in particular 



ways , 
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' • ^ This report documents the results of a series X)f studies^*designed 

to >lucidate the parameters of hum^n learning from text. All the 

» ' *' > 

studies reported here- consisted* of controlled experiments in which 

§ubje'ct& were presented with textual information, t^manipulated in a 

variety of ways. Subjects' performance on a number of task% requiring 

; . * * 

the. Use ot the. textual information was measured. 

' * , • ' r • 

These experiments served several useful, purposes, First^ they 

proyide'4 data on how various parameters of texts and learning 

environments influence the ^ acc^uisition and effective use of 

information from the te;cts.. This permitted the identification of Xext 

characteristics and learning situations that, when manipfulated 

appropriately > can produce large f^|u,ctua£ipns in a person's ability to^ 

learn aad reason. . , * ' * 

"A second purpose of these experlments-^^was to provide inferences 

about the knowledge structures people use to represent information 

from texts.. The experiments supported the*'development Qf models of 

the underlying memory structures and processes * required for task 

performance and allowed the evaluation of -proppsecljirnodels against 

alternative mpdels. The development of the models wfe .moti\[ated by 

three specific goals: (1) to elucidate the proce&s-by which knowledge 

is acquired from a textual document, (2X-ttr"specify *how the acquired 

► knOwl'edge^ is represented in memory^ and (3) Vb identify how and when 

related ^'informatyan N is -"Integrated in memory. The theoretical 

determination tf^ese underlying structures and processes was central: 

to the r,es^'ar^, becab^e of the aforementioned working assumption that 

learning may ^he optima l\y facilitated by/rtiatching the structure of the 

input information to the preferred internal memory structures. 

Finally, the results of these experiments^ were useful in 

« 

suggesting and testing techniques *€or restructuring texts or the 
learning process in ways that improve such performance measures as 
reading time, amount of information learned, length of time tHe 
information is retained, arid inferential ability. 

Two broad task domains were chosen in which to study the 
structures and processes underlying human performance with texts. The 



fi>cst tasl^' domain was simple ACQUISITION, in which the reader attempts 
to learn ;and retain as much knbwledge from the text as possible. The 
second tas^ domain was INFERENTIAL REASONING, in which the reader must 
•organize a.^ set of facts from the text in order to generate or verify a 
conclusion! following from the facts. For tot^ t*sk domain^, the^ 
approach taken/ was to model the represehtatio/i of knowledge in memory 
and the associated processes required to perform tho task, a.nd then to 
design text presentation formats that facilitated both the transfer of 
knowledge from texts into these membry structures and the performance 
ot inferential 'reasoning. . ' " ♦ 

Five sets of studies evaluated particular models and optimization 
techniques. Each study, consisted of one or more experimeut^ designed 
to ♦ determine the nature of the structures and processes underlying 
text learning ahd/or to evaluate the efficacy . of various techniques 
for facilitating performance. The methodology, results, conclusions, 
and evaluation of ' proposed models' of each of these studies is 
presented in detail in 'Eh^-^^l lowing chapters. A brief description of 
each of these studies is jgiven beloW. - -c.^ 

In Study 1, a model of "schematic" learnirtg^^^s developed that 
provides an account of how knowledge in memory is "used to guide the 
acquisition and organization of new, ♦ incoming information. The. 
advantages of and constraints on' the acquisition of new knowledge that: 
conformed to a previously learned structure,, or schema, were 
investigated experimentally. Subjects received various amounts of 
training on a set of structures by reading texts that utilized the 
structures; they then tried to learn a new set of texts that conformed 
to those structures. Memory for this new set was facilitated by prior 
experience with the t^ext organizations, particularly when there was no 
confusion among the facts from different texts th?t shared a common 
organization. ' ' 

In Study 2, information from newspaper stories was restructured 
into different formats in ap attempt to affect me-nory for the stories. 
These formats included a condensed version of the news story (with all 
redundant and superfluous information deleted),- a narrative structure 



based on the temporal order of events, a topical structure organized 
according to the primary* concepts, of the passage, and an outline 
structure that reduced the text to key phrases spatially arranged on 
the page in outline fopn. All forms of restructuring produced 
significant improvements in recall of the information contained in the 
passage* 

* • • • . 

Study 3 investigated the .integration of related but separately 

^acquired facts in memory either for apprehension of a complex idea or 

•'for performing inferential reasoning. Integration of separate facts 

into a unified memory structure was morfe likely to occur if related 
facts occurred in close temporal proximity and if the facts cued each 

other with similar wordings^ rather than with paraphrased wordings. 

The integration of facts significantly improved the ability to recatl 

related information and perform syllogistic reasoning. A model of 

knowledge representation and integration in memory was developed and 

evaluated against numerous alternative models. 

Techniques for improving a learner's ability to organize diverse 

information for inferencing were investigated in Studies 4 and 5. In 

Study 4, subjects verified inferences based on information from two 

distinct texts. Performance was better when subjects had attempted to 

commit the texts to memory than when they were 'allowed to inspect the 

texts freely during the reasoning t^'^st. This result .seems to indicate 

that meiiAory can automatically organize related facts more reliably 

than conscious information-seeking searches of available, external 

sources. Based on these findings, a model of search and retrieval is 

^proposed to account for ^ these surprising results. 

\ 

• In\ Studv 5, method , of annotating texts to facilitate integration 

\ 

and inferencing were investigated. Subjects read texts containing 
pairs oljf facts that could be integrated to support inferences. The 
second f^ct in each pair was annotated either with a footnote that 
repeated the first related fact, a footnote that contained the first 
fact and the appropriate inference following from the two facts, 'or no 
additional information. Cn a later test of reasoning, subjects whp 
had received only the fact (but not the ' infereLce) annotation 
performed best. ' . • 




Th6 results of 'each study, are predated in the context of a set 
of models for knowledge representatioy and processing. s^udy may 

stand alone ^ in addressing X particular ifesue in knowledge 
representation. ' The undei>lying theoretical ' assumptions and 
conclusions following from each study are discussed separately in each 
chapter. .However, taken together, these studies provide ai unified 
corpus of research on related /issues in learning and \ reasoning. The 
models, while addressing different %aSk domains, share' a common set of 
underlying assumptions about the structure of human memory. The 
individual studies are presented in detail in Chaps. II through VI. 
Based on these models and the obtained experimental results, a set of 
principles for improving human learning and performance witfi texts has 
emerged. These principles are presented in Chap. VII, accompanied by 
brief descriptions . of supporting data and references to the chapters 
in which particular results are dfscussed in detail. 



n. THE USE OF SCHEMATA IN 'THE ACQUISITION AND TRANSFER OF ^KNQWiAgE 

f • ^ . ^ • * ♦ 

Rece/it theoretical research on human memory has been stimulated 

by the rediscovery of. the concept of the "memory schema.'.' The notion 

of a schema was' first introduced by Head (1920), who, claimed that 

anything that enters consciousness is "charged with its relation to 

somttLhing that has gone before/' Wobdworth (193?);. in his classic 

textbook, on exprerimental psychology, extensively utilized tl^ concept 
of.^ schema to describe various' perceptual and memory phenomena, ' A 

memory schema, as it is typically xoncep.tualizied' today, ^s a cluster 
of .knowledge (a 3et*of concepts and associations among *the concepts) 
that defines a ^more complex arid frequently encountered concept. A 
schema may represent anything from the componential features pf a face 
(ct\ Palmer, 1975) to the prototypical behaviors one engages in when 
going to a restaurant for _a,_jaea]^_^chank & Abel son, 1975). The 
concepts that constitute a schema may bfe perceptual features, s*emantic 
primitives, events or situations in the world, or, recursively, other 
schemata. Thus, schemata of varying, levels • of coinplexity coexist in 
memory. , . 

The revival of interest in memory schemata as a theoretical 
construct is principally . attributable to two lines of research. The 
firsts conducted in the domain of artificial- intelligence research, 
has soughb to define new data structures for encoding complex 
descripXion^s of *the world. The result has been a .proliferation of 
knowledge representations that utilize some form of knowledge 
clus-tering such as ^'frames*' (Minsky, 1975; Wiq^grad, -1975; Kuipers, 
1975)» "scripts". (Schank & 'Abelson, 1975, 1977), or other forms of 
sche^ta (Schhiidt, 1976; Moore & Newell, 1974). A seicond area in 
which schemata have received extensive treatment has been that of 
memory for connected discourse. Bartlett'V (1932) seminal studies of 
pi-ose memory led him to conclude that memory for a story consisted of 
a schema or plot framework and some associated details from the 



passage. Extendi'ng Bartlett's early ideas, several researchers baye\ 

recently begun to ifse schemata ^ to model the *undeirlying memory, 

structures that encode prose information . (Rumelhart, 1975; Schairk, 

1975; Thorndyke, 1976, 1977, 1^78; Kintsch, 1975; yan Dljk & Kintsch/ 

19/7; Winograd, 1077;J Dooling & Christiaansen, 1977; P.ichert 

Anderson, 1977; ^nderson, Spiro, & Anderson, 1977; Anderson, 'Reyn&TJis , 

Schaliert\ & Goet2,^9^76). ' ^ / ; 

With thi^^ resurgence of incerest in memory schemata, a few 

researche^ijs have attempted to formulate general j yet comprehensive ^ 
memory models organized around tj^e concept of 'knoWledgef schemata 

(e.g., .Normai>'& Bobrow, 1975; fiobiW & Norman, 1975; Rumelhart & 

Ortony, V977; R. C. Anderson, 1977). While each formulation of memory 

schemata has its unique characteristics, there seem to be a few 

properties common to each variant: 

* • ' <^ . «, ,• ^ • . 

1« A ;5chema represents a prototypical abstraction of the complex 

concept it represents. This abstraction contains a description of tiie 

composition and' properties of the concept. For example, .a '*face" 

scheima might specify th^t a typical fdce possesses 'two ey^s, a nos.e, a 

mouth, and two ears, even though a pai^ticular face missing one or more 

of these features is sCill a face» • • * ' • * • ^ V 

2* Schemata are induced from^ past experience .with i^umerous^ 

' ' * J 

exemplars of the f\complex concepts thc^y irepresent. /Presumably, we^ 

abstract the concept' of a face after seeing many of them. 

3. A schema can. guide the organization of inc.oming information 

into clusters * of » knowledge that are "instantiations'* of the schema^ 

This^epres^nts .a goal-directed focusing^ of . processing by active 

memory schemata. Thus, when we catch/ a glimpse of a head, we activate 

our face schema and use the properties assumed by it to guide. our 

searclx^br features ori the face we are viewing. 

* 4. A^eli one of the constituent concepts of a schema is missing 
iu the inpift, its features can be inferred from "default values" in 
the schema. If the face is in shadow and we cannot see the mouth, we 
may still reasonably infer t>6aC"it has two lips. / 

Previous attempts to formulate general "schema" theories of 
memory have had two principal shortcomings. Firsts the ^theories have 



^peen so vaguely specified oi^ genc:^! that they are able to' explain 
post hoc any set of available data* While many data may be taken to 
be consistent with schema theories, it is difficult to find any data 
that are- inconsistent with them* Sect^nd, the thepries proposed" thuB 
far have been use^ only descriptively » to account fojr vexist-ing ^ data. 

>^They.^ .have qot^ been sufficiently well-specified to bemused 

predictively; For example^^ it ii^^ot clear what a schema theory would • 
' * ' i ''^ . - • \ ** , . . 

' predict about memory for ar^ anomalous 'dat^um, .i.e., a: constituent 
*" , ^'* */ . * .** 

detail inv^ set of infontfati^n that did not fit the schema invoked ta 

' comprehend th^at information* Woi^ld it; be well learned as a surprising 

* stimulus ('i.e., a von Restorf effect .for schemata), or ^wdUld it be 
poorrLy learned because it did tiot^ conform to the prototypical encoding 
structure? - ^ ^ - • ' ^' \ ^ , # 

^ The purpose of this chapter is to- operationalize soihe Vi the 
oretical (Constructs th^t underlie schema theory in a ^odel of 
Learning from simple texts/.* I'he model repres^ents a marriage between^* 
previous work on the acquisition and sharing of memory schemata * 
(Thorndyke., 1977) and 'the dynamics of learning and transfer of shared 
knowledge (Hayes-Roth, 197^ * Many*, assumptions 'of the model draw upon 

^ classical research in learning. Some details of potential mechanisms 
for learning information in terms of schemati^ will be presented,. The 
novel predic^ons of this learning model were tested in two prose 
learning experiments; the results are discussed later in this chapter. . 

In the . remainder; of this chapter, the term "schema" will bfe us^ 
to refer to a configuration of concepts, and associations among the 
concepts that are repeatedly ^invoked to encode unique stimulus events* 

«The concepts in the schema represent abstractions or generalizations 
of /the originally presented concepts that invoke the schemd. This* 
configuration of concepts may represent knowledge exogenous to the 
syntactic and semantic relationships ip the original inputs,' as in the 
case /of narrative schemata Imposed by ai reader on the^ events of a* 
story to facilitate comprehension (Rumelhart, 1975; Thorndyke, 1977; 
Handler & Johnson, Jl^lT) . In this case, the schema represents 
higher-border implicit relationships among concepts that would 
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embellish a conventioaal prepositional ^rej^esentation of the 

linguistic input. However, this study. is concerned with a sinipler 

form of schema, une In which the configuration pf concepts represents 

a simple sharing of frequently repeated information* ThaJ^ is, the 

srt),ema is ^ abstraction of a set of concjepts and relationships that 

explicitly occur in a number of unique contexts. . Because* the schema 

is -an ^Ibstractipn of explicit knowted.{e, it* has a' structural integrity 

that is , independent of any particular occurrence of the con(5epts that 
utilize it for their representation^ • 

As. an example, suppose one were to learn some;, information abo;ut 
the figures r^resent^d on ftount Rushmore. This information lught be 

provided in a sel(iiiinc6 o^ piropie t^exts as follows: 

\ Text 1: George Washington was the first President of the 
United States. ' He lived in Mount . Vernon. 

* T-ext 2: .Thomas Jefferson was the third President- of the, 
United litates . . He lived in Monticello. 

Te/t* 3: Abraham I iacola was the i6th President ^f the 




^ United States. J je Ijjj fced in^ a log cabin. 



Text 4: Theodore Roosevelt was the 26th .President of the 
United States. He lived in Sagamore Hill. 

A simplified representation of a portion o'^^'^is information in .a 
i _ , . ^ . • ^ 

conv^nt/onal memory model is given in Fig. 2M. The occurrence of 

eacb^text constitutes a new. context, and noae .of the presented 

information stored in . memory is shared between contexts,- (^'^^l^ 

pxopositional models would assume indirect associative connections 

between' repeated occurrences of a concept such as "President" and 

**lived,** mediated by direct/associations through a common type^node. 

However, only the individual occurrences, or "tokens," are depicted 

here, for simplicity.) 

Much of .the information in Texts 1 through A is identical. The 

predicates or relations in the texts are repeated., but the arguments 

to the predicates ar^ different in each of the texts, ^^That is^ • t^e 

knowledge in these texts might be conceptualized a^ "Text i states 

that person i was the N^.-th President of the United States ancl 
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*^Fig. 2.1 — A hypothetical repre's^ntation of the Informatioh^^lTi^ 
I Texts 1-3 iti a conventional p>r6positional 

. • memory model . * 



lived in location L. 



All texts share the common infoJlfeati^on \,l)ut 
•differ in the details of person, number, andls^cation, Jf these texts 
were learned together, . their respective - represei^tations might be 
integrated by the sharing of 'a common subrepresentation encoding the 
repeated information (see Chap. IV): * This shaVed knowledge would 
constitute a schema in which the repeated concepts serVed as varviSlSles 
that • could take on -Afferent values for each new occurrence. Figure 
2.2 shows the resultant integrated , structure and shared s<:hema. The 
concepts labeled N^, Person*!, and represent^ placehQ.lders , or/ 

slobs, that are assQciated with (i.e., bind) different values for each 
new usage of the schema. In essence, these concepts are type nodes 
within the schema that subsume the tokens, or d^ta^lfed^ values, that^ 
occurred in the various contexts. The context in wKich each detailed 
value occurred is preserved by means of a l^bel'on the link between 
the value and the abstracted concept that subsumes it. In Rig. 2.2^ 
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these\ links are labeled with the numbers of the texts in which the 
detail^ occurred (1 through 4). These linHs may be thought oi as 
context labels or time tags for the presented details^ ' similar t'o ^ 
those postulated in other, propositional models (e.g., Anderson & < 

. Bower, 19^3). ' ■ f 

We assume that knowle^dge in memory is- frequently • -organized ow^j^th 

^he use of , such" schemata. In j)art.icular,, we believe that a knowledge 
structure formed in the representation of information from one, context 
can be used to represent the same information occurring in different 
•contexts (Hayes-Roth, 1977; Thorndyke^ 1977). The use of a schema for 
encoding information depends, of course, on the successful activation i 
of the* re*levaht . sdhema in memory at ^cpmprehensioh time.. Such 
activation is probabilistic wid depends upon such fa^ctors as ^ the 
strength of tW& 'stored inf prmat ion, , the extent of the overlap or match' 
between input and schema^' and the amount- of time since the previous* 
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activation. These issues are treated elsewhere (Hayes-*Roth| 1977, 

Chap. IV) and wilt hot be addressed here* father, the concern here is 

to specify how the existence of such s»chemata influences the learning 

and retention of information that is represented with the*u^ of /the 

schemata. For^ example^ given our assumption that- the information in 

Texts I >hrough 4 is represented aL shown in Fig. 2.2, we wi^h to 

model * how the^ acquisition of Texjt 4 will be ^ influenced the prior 

acquisition of Texts 1 through 3, 

' . . ' • . ' ■ ' • . 

We assume that the use o^ a sqhema for encoding or reprieving 

intormation d^*pends on itaC^accessibility in memory (Tulving & 

Pearlstone, l966i.-ttayes-Roth, 1977). The acccfssibliity of ^a schema Js 

the prbbability t)iat it can be activated^ either for use in storage of 

incoming information , or for retrieval^ of previously stoifed 

iTif ormation . Accessibility of a schema>^depends upon such factors as 

th€? strength of the stored information, the extent of the overlap or 

match between input and schema, a^d the* recency and frequency of 

previous activations. Each time a^ schema is activated for lise, it 

becomes, more accessible for successive activa'l.ions . The incremental 

effect of an activation on the accessibility of a scheiqa is presugiably 

a decreasing function of its prior strengths That is, a weak schema 

benefits more from an activation than ."^ strong one. The assumption 

that accessibility of^ information i*ncx;eases with' the frequency of 

activation and strength in memory has been proposed previously and has 

received considerable empirical support (Underw6od, Runquist, .& 

Schuiz, 1959; Jung, 1963? Hayes-Roth & Hayes-Roth, 1975; Perlmutter, 

Sorce, & Myers, 1976; Hayes-Roth & Thorndyke, 1978). 

^ When multiple details instantiate a variable concept in a schema, 

it is assumed that they compete with one another for associations with 

the variable concept. As the number of competing details increases ^ a 

person's ability to discriminate (and thus recall corr.ectly) the 

context in which each detail occurred decreases. The discriminability 

among details associated with a single variable concept is assumed to 

be an inverse function of the number of competing concepts a^d the 

temporal proximity of their occurrences. The postulated effects of 



Uecreasing discriminability with • increasing numbers of competing 

details are . derived from previous ^ vork on interference in. 

paired-assQipiate transfer. In particular, these ideas resemble the 

notions of response -competition (McGeogh, 1942; Osgood, 1949) and 

list-differentiation difficulty (Uia(|^'rwood, 1945; Underwood & 

Ekstrand, 1967; Anderson & Bower,; 1972) in recall of paired 

associates*^ ' More recent studies have demonstrated that> learning 

multiple propositions #bout a concept interferes with verifying any 

one of theiu (Thorndyke S^Boyer^ 1974; Anderson, 1974; Hayes -Roth & 
'Hay'es-4iOth, 1975)/. • - a 

Note thdt wf postulate both benei{t^ and costs associated with 

the use of schemata in ^ learning. The-^ benefits derive from th'e 

' # 
availability of previously learned representations of knowledge for 

use in* the encoding of novel information. The strength of the prior 

information, . the schema, incremented, by the new ^tivation required 

for the representation of the novel information should be greater^ than 

the strengiii the repr^sentatjloti of that' inf orniation in a completely 

'^nc/^^el struciiirr. On the other^hand, the addit^'ion of novel information 

to the shaied schema entails^ompetition for associations among all 

the concepts "nec^sarily sharing the salne schefna. Such ^competition 

should inhibit the acquisition process and prodtice interference iri 

L-ecall of the detailed concepts at retrieval time. * 

EXPERIMENT I • • . - ^ 

Tht assumptions were tested in an experiment utilizing a 
transfer ^ paradigm* Subjects learned a variable number . of* texts (the 
training texts) about a conceptual categor;^, such as constellations. 
The topic of each text, in the set was a different iristance in that 
category, e.g*, the constellations Pisces, Aries, ^ Scorpio, etc* * 
Subjects then learned and were tested on a transfer text '(the target 
text) describing a new rnstance in the same category. Each sentence 
in the target passage had a corresponding sentence in all of the 
training passages that bore a particular relationship to it. For 
example, suppose the target passage contained t|tie sentence "This 
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consCellatiorf was originally charted at Halomar Observatory." The 

corresponding sentence in all'previous training stories could then be 

one of three types:. In the REPEATED condition, th* entire sentence 

was jrepeated intact in. all training stories (i«e., "This constellation 

was originally charted at Palomar Observatory"). In the CHANGED 

condition I the predicate wa^ ijdentical but a detailed case or argument 
♦ 

to the predicate was changed in each of the training j^assages* For 
example, "This constellation was originally charted a^t Mount Wflson 
Observatory" might be one such . prior senuence^ These CHANGED 
sentenced represente'd the same transfer situation as is shown in Flg« 
2.2. In the UNRELATED conditiony there was no similarity between the 
target s;entence and any^preceding training se\itences. Thus - in this 
condition, no sentences concerning the charting of the constellations 
would appear iih any training story. ^ t . 

.Subjects vere tested for retention, of the target story by- either 
ai free •recall \c cued recall t^st. On the cued recall tesL, subjects 
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were given the oredicatl^ (e»g'> "This constellation was chai*ted a 
and asked ^o recall the target detail. Using t}ie* assumptions given 
^above^^we may now predict performance oh these tasks a^ a function of 
the number of training stories preceding the target story. x 

Figure 2.3a shows the qualitative effects on learning, and 
retention of information from the target passage plotted agafnst the 

number of training passages. The ordinate' values above the origin 

I 

indicate increasing positive effects on learning; the values below the 
origin indicate increasing negative effects on learning. During 
acquisition of the training passage!, the repetition of substructures 
of the passages produceg^a representation ip memory that is shared by 
all occurrences of that substructure. Repeated activation of the 
schema* strengthens its representation, even when the details that 
instantiate it are unique in each context. Therefore, the 
accessibility of the schema for both storage and free recall of the 
target passage is a monotoriically increasing function of the' number of 
training passages. Because the benefit of an additional activation is 
.a decreasing function of prior schema strength, the function is 
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negatively accelerated. That is, the slope ot the function is , steep 
/ in the early ^ages of learning and eventually readies an asymptote ' 
When the schema .becomes vfery well learned^ as shown ^in Fig. 2,3a. 

On the ^^er hand, when details are' changed in the successive' 
occurrences of the schema (as in the CHANGED sentences), the 
discriminability of the contekt labels associated with the changed 
details produces a monotonically decreasing, or negative, effect on 
learni^^ This negative effect appears at some point following the 
establisfh^ ol the sparable schema representaion; that is, the 
schema must be established before it can be shared. ^Thus the positive 
effects of accessibility are initially stronger than the negative 
effects of decreased , discriminability . The discriminability function 
presumably reaches asymptote at some point dui:ing training after the 
^^ accessibility function reaches its asymptote. \ 

The qualitative-effects functions shown in Fig. 2.3a may be 
Operational ized as pi^obabilistic behaviors defined oVer the range C 
(O,!). For example, the accessibility of the scher||^ on the free 

* * 

reciall task can be directly measured as the probability of recall of 
the sentence schema, or predicate. This probability nl^y ^be^esignated ^ 
as P(Predicate) . Since the numbe>'r of training passages increases from 
.zero, this function begins at some^value greater than zero and 
increases monotonically to an asymptote less than or equal to one. 
The detail discriminability function may be operationali^ed as the- 
conditional probability of recalling tKe sentence detail, given recall^ 
of the predicate, or PCDetail/Predigate) . This probability measures 
recall of the sentence detail, given tha-t the predicate was 
•successfully retrieved from memory. Differences in this probability 
across varying numbers of training passages are * presumed to reflect 
only differences in a person's ability to retrieve the appropriate • 
detail after the predicate was successfully retrieved. As the number 
of training passages ^increases, ^the function describing' this 
probability Vs assumed to start at a V^lue less than or equal to one 
and decrease to in , asymptote greater than zero. Both functions are 
assumed to have non-negligible ranges. . That is, there is measurable 
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variation in both probabilities across training conditions. In 
* addition^ it is assumed that the domain over which the two functions 

vary is similar; that is> the variation between the times whfen the two 
functions reach their asymptotes is nQt vast. ' • 

When operationalized in; this manner, these functions may be 
..combined to predict 'subjects' performance on the recall tasks. 
Correct free recall" of a sentence requires n>caM of both predicate 
' and detail from thie sentence* Thus the probability of sentence recall 
may be designated a,j5 PCPredi,cate and Detail*). This probability may be 
expressed as the product^ of the two otheiT probabilities : 

\ *- ■■ . ■ / 

^ P(Predicate and Detail) = P(Predicate) x P(Detail/Pr«dicate) . 
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That is, the predicted function for* CHANGED sentence recall is the 
product of the two effects' functions in Fig. 2.3a; . Given tfi.e 
assumptions listed above, the shape of this recall function should be 
that depicted by the lower line in Firg. 2.3b. As the '^number of 
training passages increases, recall of the CHANGED 'target sentences 
shoUld initially increase, then decrease, eventually reaching 
asymptote. This resiflt should^ef lect the increasing accessib'ility of 
(.the schema, coupled with inctea^ng interference in recall of details.' 
Since no assumptions were made #DOUt the starting or asyi:q)totic values 
of the component probability functions, the ^solute magnitudes of the 
component functions and the i:esulting free recall function cannot be 
predicted. Therefore, the relative values of the functions shown in 
Fig. 2.3b should not be taken literally. Howev^ls^. as long as the 
effects functions^ exhibit the depicted shape ^^d satisfy the^ 
assiiwptions listed above, the qualitative shape of the free recall 
functfdn may be predicted. 

Similarly, we may predict the free recall function for the detail 
portion of the CHANGED sentences. This probability, desigi^ated as 
P(Detail), may be derived from the equation 

P(Predicate and Detail) = P(Detail) x P(Predicate/Detail) . 
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The factor PCPredicqte/Det^iil) is thfc probability of * recall of the 

sentence predicate,* given recall of the sentence- detail. It is 

assumed that a subject rarely, if eveV, recalls a detail without 

recalling" the sentence schema ^in which, it is embedded. Therefore, 

this probability should be one or very close to'' one and should not 

vary* across different numbers of'training passages.* If this is tfe 

case, then the probability of recalling a CHANGED sentence detail, 

P(Detail)., . should be approximately equ^l to the' probability of 

recalling the entire sentence, P(Predicate • and Detail)* Thus the 

functions describing these probabilities across varying . numbers of 

training passages should be nearly identical. ^ 

For REPEATED items, the entire sentence wis repeated .intact in 

each of Jjie training passages and the target passage. 

Discriminability of context.s would not be a j^foblem in this case, 

since, the' information was identical in all contexts.* Therefore, 

predi(^ted free'recall for REPEATED sentences should reflect a simple 

repetM:ion effect--a monotonic increase with increasing numbers of 

training passages as predicted by the accessibility function alone. 

For UNRELATED items, no rplated seutences occurred in any of the 

training passages. Therefore, recall of these sentences should be 

lower than recall of CHANGED or REPEATED sentences and should not vary 

» 

across increasing numbers of training passages* 

On the cued recall test, subjects were given the sentence 
predicates as cues to recall the detailed case fillers* Each cue was 
the portion of the stored schema relevant for recall, of the tested 
sentence. Thus the probability of accessibility of the schema at 
retrieval time would be essentially one and independent of the number 
of training passages. (Some small decrement' in theSrccessibility of 
the cued schema might exist when small numbers of training passages 
had been* presented, reflecting a weakly established memory 
repre^^fttat ton. ) "This accessibility function for the cued recall test 
is shown as the top line in Fig. ^..3a. In this case, predicted 
performance for cued ' recall of CHANGED sentences is just 
P(Detai 1/Predicate) , or the same as the discriminability function^* 



This predicted function is sh6wn as the bottom line in Fig* 2,3b. 
Cued recall of CHANGED sentenced should be a monotonic -non-lncreasing 
function of the number x>f training passages. The cued recall function 
should initially be flat or slightly decreasing at a value greater 
than the peak of the free recall function, Thed this ftinc t ion- ^should . 
exhibit a significant decr^^e, eventually, ending at asymptote. 

Method * ' ' ^ ^ 

Materials > Five, to^be-recalled stories (hereafter referred, to 
as "target'' stories) were used. Each of these stories was unrelated 
to the others in topic and content. The titles of the five stories 
Vexe \"The 3ilicosis Disease," "The Apus Constellation," "The 'Circle 
J^dand Story," "The John Paytan Biography,? and "The Filicules Plant,/' 
Each passage contained 12 sentences. For each target, story, eight 
"training" passages were constructed that were different 
instantiations of the same general topic as the target passage. . For 
example, the trainihg passages for the Apus constellation story were 
about the Lepus constellation, the Pavo constellatioh, the Eranus . 
constellation, and so on. 

Each of the 12 s'eiftences in a training' passage corresponded to 
the sentence in the same serial position in its target story. The 
correspondence could* be of one of three types: REPEATED, CHAliGED, or 
UNRELATED. Each passage contained four sentences of each type. All- 
.sentences were approximately equivalent' in semantic and syntactic 
complexity. For REPEATED sentences, the same fact was repeated 
verbatim in each of the eight training passages and target jjtory. For 
example, if sentence 7 of t*he target passage was "It was' originally^ 
charted at Palomar Observatory," then sentence 7 in each of the 
training passages would be identical. For CHANGED sentences, the same 
predicate was repeated in training and target passages^ but in each 
instance it was instanti^ated with a different detail. So if sentence 
7 in the target passage was in the CHANGED condition, one 
corresponding sentence in a training passage might be "It was 
originally charted at Mount Wilson Observatory." Thus in each of the 



eight training piEissages, the predicate "It was originally' charted at 
..." wasj^ instantiated with a unique detail. For UNRELATED seniences, 
the^was no syntactic or semantic felaitionship among corresponding 
sentences dn the training .and target passages. Thus sentence 7 in two 
of the training passages might be "It was found to contain hydrogen 
gas'V and/'It is approximately 400 light years from earth. 

For each subject^ a new set of eight training passages for ^each 
target story was generated. ^First, the assignment of sentences in the 
target story to traiaing condition (REPEATED, CHANGED, or UNRELATED) 
was randomized. Then, fbr each training passage to be constructed, 
the • CHANGED and UNRELATED sentence^ were selected without replacement 
from the pool of ^8 possible sentences in the designated serial 
position (I through 12) and Sentence condition (CHANGED or UNRELATED). 
Thus for each subject, the generation of new fliaterial provided a 

randomized* assignment of items to condition and a randomized selection 

%\ " • . 

of training materials. 

* * V * 

Subjects . One hundred UCLA undergraduates participated in the 
experiment, either for pay. or to. satisfy a course requirement. 

Design , A 5 x 3 x ^2 x 2 factorial design was used. Sentence 
type (REPEATED > CHANGED^! or UNRELATED) and the number of training 
passage? preceding a target passage "were — within* subject variables. 
Each of the five target stories was preceded by either 1» 2, 3, 4, or 
8 training passages. The assignment of target story* to training 
condition -Ml through 8) was counterbalanced across subjects. Since 
each target story J;ontained four sentences of each type, there were .20 
of eath sentence type per subject. One between-subject variable wa>^ 
the ^atention ^interval for the target passages (either 10 minutes or 
24 hours). The other between-subject variable Was test type (either 
free or cued recall). Different subjects performed these two tasks to 
insure against an artifactual effect of one task on performance of the 
other. The two grpups defined by the ^two" retention intervals will be 
referred. to as the 0/0 group (0 hours between presentation of the 
training and target passages, 0-liour retention iiiterval) and the 0/24 
group (0-hour training-to-target interval, 24-hour target retention 



^interval). Each dff the 100 subjects was randomly assigned to one. of 
the four .groups so that there were 25 subjects in each group. J 

^ .Procedure. Subjects we r6 tested in groups of from one to eight 

persons. The expeifiment-al materials were included in threerpart 

' ,.. ■ ' 

booklets provided to subjects, who <*orked at. their own pace. 

' ' ' • • \ 

Intentional learning instructions were given. Subjects' were, told to 

•'<'<.'.■' 

read -the stories carefully because they would be tested, on them later. 
Subjects then proceeded to Part 'I of the booklets-, Which coj^tained the 
training passages^ • The stories were printed one per «page. ; Subjects 
were allowed to read- through the passages at tlieir own pace but were 
not allowed tb turn bac^ to previous storieis at any time. The* first 
story was a buffer story, unrelated to all others in the experioient 
and identical for all subjects. The next 18 passages (1 + 2 3 4 + 
^) were the training passages for the five target stories. Their 
order was randomized, with the constraint that one story of. each type 
must occur in, the last five serial positions* The final passage in 
the training sequence was unrelated to all ot^hers in the set and 
served .as a. buffer tb minimize any recency effects in short-term 
memory. Following this final passage, subjects worked on 
'multiplication^, problems that took approximately 10 minutes to 
complete. , ^ ^ . 

In Part II, the intentional learning instructions were repeated. 
Then the five target storie\s were presented, one per page, in random 
order for each subject. The^ target stories were surrounded by 
unrelated buffer stories^ as in Part I. The study procedure was 
identical to that in Part I. ■ ' ' 

% 

The 0/0 subjects then proceeded directly to Part III, the recall 
test for the target stories. The 0/24 subjects were dismissed until 
the next day, when they reconvened for the recall test. The target 
stories were tested in the same order as they had been presented in 
Part II. Subjects receiving the >free recall test were instructed to 
write, for each story, as close to a verbatim recall of the story as 
they could. However, they were told not to omit anything that they 
Remembered if they were unsure of exact wbrdings^ or sentence order. 

4 




Subjects receiving the cued recall test performed a sentence 
completion task for e^ch targdt passage. The stories were presented 
as in Part 11^, with the detail instantiating each predicate ^ omitted 
for. each sentence* Subjects were instructed to fill in the missing 
po^rtion with as -close ^o the exact word or word's as they could, 
remember* Writing time for both free and' cued recall tasks was 
unlimited. ^ ,^ 

'J 

Results . . ^ ' 

The results from the free and cued * recall tests were analyzed 
separately. All data were initially analyzed using an analysis of 
variance that treated sentence type, nuinbet^of training stories, ^ and 
retention interval ais factors. Airline t^rans format ions on proportions 
were ijtsed for the analysis to insure homogeneity of cell variances. 
For free recall, prbtocols were scored for gist 'recall of the 
presented' information, with the, exception noted below. For. , each 

sentence, it. was determined whether the predicate had been recalled 

.•J 

correctly, whether the detailed case filler had been * recalled 
correctly, and whether the entire sentence (predicate plus detail) had 
boen , recalled correctly. In scoring recall of details, a paraphrased 

recall was coupted correct only if it unambiguously specified the 

* ♦ . t . 

i 

target detail and none of the corresponding training deta,ils. In 
cases in whiqh paraphrase recall w^s impossible^ (e*g., recall of a 
year), exact recall was required for the. trained item .to be counted 
correct. A. single scorer analyzed free recall protocols. 

In each of the four groups (both free and cued recall in the 0/0 
and 0/24 conditions), the mean number of UNRELATED items correctly 
recalled did not vary as a function of the nuiiiber of prior training 
stories, as, predicted by the thefery^bove. As a result, for each 
subject, the mean number of UNRELATED i^^ms corrrectly recalled was 
averaged across the five training conditions (1, 2, 3, 4, 8) and was 
treated as a control or "0*' training condition. That is, this value 
was used as an estimate of recall of a target itemvjyhen no related 
sentences had preceded it duri'fi^^ji^^tT^ining. 



. . the results for frp^ retail of entire sentencj^s are summarized in 
Fig. 2.4. .Overall, Subjects recalled Wre ,on the^^^iimriediat.e test 

V (0/0 group) than pn -^t-he delayed test (0/24 group), F(l, 720) 12.37, 
< .001. The effect of number of training stories was significant, 
F(4, 720) = 14.78., £' < .OQl, as was the type of sentence, F(2, ^02) =. 
249.06, £ < .001. For REPEATp sentences, recall, increased^ with 
increasing number of. training stories fjpr both the 0/0 and 0/24 

v.groups. As predicted*, tHfe. recall of CHANGED sentences in the 
immediate test condition initially increases from the zero point, then 
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Fig. 2.4~Free recall entire REPEATED and CHANGED sentences ^ 

*k in Experiment 1 



-decreases, then reaches asymptote. Since no quantitative ptedictijpns 
were inadi* regarding the fex»ct location of the peak or the location q1 
the asymptote relative to the zero point, there ia no straightforward 
statistical test to evaluate the fit of the data to the predicted 
function. Several potential configurations of recall data would hive 
been consistent with the prediction of an increase, foll,owed by a 
deciease, followed by an asymptote. Therefore, the following Monte 
Carlo, method was j^ised.to evaluate the reliability of this result. 

For each subject, the mean recall scotes of CHANGED sentences in 
the six training , conditions were randomized and reassigned to the 
conditions. This was done for all 25 subjects, and the mean simulated' 
recall curve was computed and plotted. This randomization was 
performed 100 times to* produce 100 graphs of simulated recall. TLd 
graphs of the obtained data and the 100 randomizations were then 
r^ink-ordered for.. their fit to the predictions, by 'two independent 
judges,^ both of whom were thoroughly familiar with the theory and 
predictions but had not seen the obtained data. The rank order of the 
teal data then constituted the probability th>t a fit to tlie predicted- 
function by the^ata couiid be obtained by chance. For both 'raters, 
this probability was g = .05. While the immediate recall of CHANGED 
sentences showed the predicted inverted U-shaped function, after .a 
retention interval of 24 hours the differences were ^eliminated and 
recall was very poo,r. . 

Thesd . results for free recall of sentences are broken down into 
separate recall of predicates and details in Fig. 2.5. For REPEATED 
sentences, immediate recall of predicates and details was virtually 
idE-ntical. In 'addition, free recall of predicates from CHANGED sen- 
tences was as accurate as recall of REPEATED predicates, t(4) = 1.82, 
n.s. After ^ 24-hour retention interval, recall of- predicates 
dropped significantly across all training conditions but still 
reflected the increasing effect on recall of number of training 
stories. This is * shown by the line for recall of the CHANGED 
predicates in the 0/24 condition in Fig. 2.5. 

While recall" \)f predicates for the CHANGED' sentences increased 
with number of training stories in both jmmediate and delay 
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conditions, ' inwedifte recall o^ CHANGED details- increased, then 
decreased to asymptote. Thus the sentence ' free recall function in 
Fig. >• 2.4 for CHANGEI>, items reflected fluctuations in rpcall' of 
details, not predicates. The fit' of the recall irfn^,tibn- fotv CHANGED 
details in Fig. 2';5 to the^predicted function was tested using the 
same 'randomization method for details as was described above for 
sentence recall. The attained significance ley«ls for the recall. 3ata 
us obtained from the two independent raters yere £ = .04 and £ =.06. 
The intrusions of CHANGED det*ai1ts Vrpm training stories" into 
recall of CHAHGED target passages are also shown in Fig. 2.5. While 
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Fig* 2.5 — Free recall of sentence ^constituents (pr'^lJicates and 

details) in Experiment "^1^ 



correct recall of .details increased, intrusions did not vary from 
their b9se» or Jtero, level. (The zero point the j^^bability of 
intruding an UNRELATED sentence from a training passage into recall of 
the target passage.) ./When correct recall of details decreased, 
intrusions Increased reliablyi . F(5, 144) - 2.31, £ < .05> Com- 
bining these two functions provides a measure of the probability of 
a schema.- relevant response for CHANGED sentences as a function of the 
number of preceding training; passages.^ That%is^ by adding the 
intrusion and correct recall probabilities for details^ we obtain the 

probability of recalling any detail that was associated' with a 
, ,* ' » * 

variable concept during training. This- function l^i'creases reliably. 

fro^ 24 pe^enL to 45. percent, F(5, 144) = 2.46,^ < .05.. 
< . The ^esifH« for cued recall are summarized in Fig. '2.6. As in 
frejr recall, performance is better on the immediate^ than on the 
delayed test,*'(l, 720) = 12.67, p < .001.. Reliable, differences, were 
obtained due to both sentence type, F(2, 720). = 214.76, £ < .001, 
and training condition, F(4, *720) = W.56, £ < .001. As fire- 
dieted, the cued recall of CHANGED details in the immediate test 
condition is initially flat and then decreases as the number of 
training stories increases, "/his decrease in cued recall is reliable 
F(5, 144) = 2.61, e < .05. By comparing Figs. 2.5 and 2.6, the rel- 
ative levels oT free and cued recall of CHANGED details may be 
noted. As predicted, the initial flat portion of the cued recall 
curve (40 percent) is higher than the highest point en the free recall 
curve (.30 percent)\ For delayed cued recall, as for free recall, 
performance hn CHANGED detaijls was poor and did not vary across 
training conditions. 

As shown in Fig.- 2.6, intrusions in cued recall of CHANGED 
details increased monotonically with number of prior training stories. 
While this result was in the expected direction, it failed to ac[iieve 
significance.' As for' free recall, the probability of generating a 
schema-relevant response to CHANGED predicate cues was computed by 
adding the correct'recall probability and intrusion probability in 
each training condition. There was ho difference in the resulting 

/ 
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response probability as a function of number of training stories; J:he 
probabilities for thte five training conditions were all within the 
i:ange of 50 to 56 percent. 



Discus sion ' * ^ ^ * 

These results confirm the predictions discussed above. During 
the acquisition phase of the experiment, subjects constructed o^chertiata 
representing common information in related passages . - With each new 
trainiq^^ passage ^ the schema representing the shared information wouid 



be activated and sUenisthened. For REPEATED sentences, . this 
activation produced |a -strengthening of the entire repeseritation of 
that sentence, as would be predicted by mahy learning, theories." Fo 
CHANGED sentences, the coininon predicate would be strengthened, but 
detail instantiating the predijcate would compete for ass.ociation with 
that predicate with other details from different .contexts. ' The 
accessibility of the shared information was m^sTsi^ed directly from 
free recall of the repeated information. As expected, accessibility 
.increased monotonicaUy with increased repetitions of the shared 
schema. The incremental accessibility of repeaj^ed information was 
independent of whether that information had "multiple associates 
(CHANGED predicates) or a single repeated associate, (REPEATED 
pffe^icates) . > - * • 

Immediate free recall of entire CHANGED, sen^gncec . and CHANGED 
Jetails confirmed the novel predicted inverted U-shaped function. 
This, function derived from the combined effects* of increased 
acdess^ib-ili^y of the shared information and decreased discriminability 
of the details as, the number of training passages increased.- The 
^cU<m that this function represents th«j product of- the a.ccessibili,ty 
and discrirainabilitj^ functions may be evaluated, by combining the data 
from the two functions.'. The accessibility function was 
operational ized as free recall of CHANGED sentence predicates. As 
expected, recall increased ^oh^ftonically yith. increased repetitions of 
,the shared schema. ' The ' incremental access^ibility pf repeated 
information was independent of whether that information had ^multiply 
associates (CHANGED predicates) or a single repeated ' associate 
(REPEATED predicates^ . ' \ 

The discriminibility effect function can be estimated from the 

cued recall data. Since providing the cue. at test time, equalized or 

' / 

nearly equalized accessibility to the schema for the various training 
conditions, recall of (^HANGED details would presumabay reflect only 
the conditional probability P(Detail/Predicate) . This was the 
operatiorializ^tion . of the discriminability-ef feet function shown^in 
Fig. 2.3a. This function predicts little change in discriminability 
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as ^ the shared schema becomes established in .memory / follo^d by 
* st'eadily^ decreasing d^scriminabili^y among the details as more and ^ 
more of them become associated with the shared predicates. As shown 
in Fig, 2,6,^'the cued i:ecall of CHANGED details shows this exact 
trend. These two component functions, the free recall of -CHANGED 
predicates and cued recall of CHANGED details, were obtained .from 
different subject- samples. The product of tqese two functions 
estimates the predicted functipn for free recall o^\CHANGED sentences. 
This function, is shown by the dashed lines in Fig'. 2 ♦A. The function 
is nearly identical .to the obtained free recall funjction and did not 
differ reliably from it, t(5) = .58, n.s. * * 

The intrusion data in fre^^ recall m&y also >tJ^' ^ used' to estimate 
the discrTiniTratrilTty^"ef^ert function. Presumably, . ^.n intrusion occurs 
when the subject suC^cessfully activates the schema ^ot recall but 
cannot discriminate th^ target detail from others he has studied, 
thereby , rrtiieying an incorrect detail* ^ According to the 
predicted-* t feet function in Fig. 2.3a, the difficulties dn 
discriminabi lity should^ be negligible for small numbers of training 
passages and then steadily increase with greater numbers of training 
passages. , That is, as the number of training passages increases, 
intrusions should initially stay the same, thej/'^'^crease. This 
precise result was obtained in free recall, as shown in Fig. 2.5. 

According to the model of schemata propbsed above,, . the 
accessibility of a schema should decreas'e as a function of the time 
since its previous activation. Therefore, in general, the longer the 
retention interval, the lower the accessibility of the schema in 
memory. In addition, the longer the retention interval, the more 
pronounced should be the negative effect of discriminability of 
details sha>mg the sche;ma. As the retention interval of shared 
knowledge increases, then, the sum of these two effects functions 
should flatten and depress the recall function. This effect was 
obtained in free recall of CHANGED sentences in the 0/24 condition, 
where recall was worse than in the immediate test condition *and did 
not vary over 'training conditions. 



If. the sharirvg ot details frori\ different contexts by a schema 
exerts a nt^gative efifwect on learning and ' rete^t ion , then inc reasing 
the discr iminabil ..Cy between the target^ and training, contexts should 
improve performance on reca.ll" of the target facts. One technique for 
improving this discriroinahi I ity would be' to decreasie the temporal' 
proximity ot the training and target passages. If. during learning -of 
the CHANGED sentences there were no negative effects of» decreased 
discriminabi I ity with increasing numbers of training passage^, then no- 
interference iti learning of CHANGED details should be obtained" by 
iiicre.ising the number of training passages. This* hypothesis was 
lostril in Kxperimeal 2. » ' ' n 

KXrV.KlMKNT J . ' ' , . *, 

lht> materials and methodology of Experiment 2 were identical to 
tho.si- *"uf WxpenniuMil I, with one important exception. Alter 
ptrseiit.il i on ot t'h\ t r'.i i u i ng . mat er i .» I s , .suh.jecl.s waited 2A .ours 
t)t»tiMe rtHi'iviuK Ihv target p.issagt^s. This 24-hour delay presunKihly 
uoiiM inc ri^ist* tlir .ttsi r imiiial)i I i ty helween Ihv traiiiiiift and, target 
dt^lails ot CHAN^lKl) .sMitenc rs' siiar iiig suigU* predicaU^s in lUv schtMtia, 
rfl.it ivr to lUr cast* in whuh tar^t^l pn^sontat loi) iiununiiute ly loilowtMl 
lrainin>». <)\ iouv^v, fvrn thr di st r iniinahi i i ty produced by the. 
j4-hour uiltMV.i'l >Vould tadt*' ovt>r .1 long reltMition int^'rval. On an 
iiimiod I .il t» I »'»sl , howt»ver/ llu* theory. woulii pr<»*4uit that tin* 
dl^.^ I niuuabi 1 » iv-e^t ttM t tuntUon in I'ig. 2.5a slu)uldl)t» fl.it .it x.tM^o 
i. ti':-.s till- v.ir-iDiis ir.iliiliiK CDUd i I i oils . 

\%.> i.'.Msi.ier Uu' pie.rii leil-.n n'Shifii I ilvy^j fuiulion in tliis 

silu.jU-ii. .\l turn- nt IrnKfl p.iss.iKt: present. iH on , 24 hnur.s would 

h.ivr i>l.^is.'il siiuf the previous .utiv.ilion ol tlie experimeill.il 
ti'-iiMt .i . III!' sli.jjn' ot the .ji i.-ssil)i 1 ily tunclion .itler Jh iioin-.s lu.iy 
he est iiii.il eit 1 roiii lli.' K'"''pl' KKl'KATKD .sent rii.i f Vn .I'll in I lie 0/24 
,.,n.lilioii ot Kxp.T ini.Mil 1 .IFik- 2.4j^in'l t lie k'-M''' ^'^ I'HANGKI) 
jn.>.!n.itr t.H.ill III lh> 0/24 loiidilloi; i K • 2 . S ) AtLT Ll'ls 

trl.Miliuii iMMiod, the .a lessil.i I Ity , fuiulion MilJ .1 lu re,i : t-.l 
III.. not. .nil .illy VM Ih iinttMsniK li.iiiiiiiK p is.s.jKf.^ . «'Ven I liougli I lie 



stfeuKths ot the schemata had faded over the retention periods 

Presentation ut the target. passages would activate ami thus strengthen 

the schemata. * However, tiie increment in accessibility would be a 

decreasing function of prior strength. Therefore, the accessibility 

function; wh i le^remaining monotonically increasing across training 

cpnditions, should be flattened considerably. 

Free rbcall of entire CHANGED sentences *and CHANGED details 

should be the product of the accessibi l.i ty- and discriminabil ity- 

Inflects iunctions. In particular,' as the number of training 

passages increases, free recall of CHANGED sentences «nd details 

should increase monotonically and should be proportional to recall 
t)t CHANGED predicates. Since the CHANGED predicates would have been 

Hit fsriittMi n times and Oie target CHANGED details would have been 

prestMitctl only once, the. former would have greater strength in memory 

and thcr>»ti»rr a higher overall probalu I i ty ot being recalltMl. How- 

r\'vw ovtM* in(rtM»sing nua)l)t*rs ot t ra i n i ng p*issages , recall of ClbVNGED 

delail.s sliDuld iui.riMse' at tlu* samtf^rate as recall of CHANGED 

prtMl 1 1 a t fs . 

in vur.l UHall, tht' effect ot the cue shonhl be to pr\)vile 
ai * t'ss I bi hi t y ti> tin* stortMl scliem.i. Any il i t t ertMrt i a 1 eftects oi 
ai 1 rss 1 1) i 1 1 1 y iluc to training con<litinns should be removed^, «}nd thus 
ojimI rt'iall ol lIHANGKl) details shoutIT ret hut only the 
di St r nn I nab I 1 ! t y-t» r 1 I ttin^titni. Tfiib ettect i s pred i cted to \)v 
nt'K I I 1 b 1 r roi.s t rainiiiK iwiulilions, so uu»d . rr^all ot CIIANGKD 
.Irtails -h.uild^ nt»t vary. ^Antither cstiniati^ot the disc rimin«ibi 1 i ty 
lijnv'lf«>n may lu* ohtained trtijn the intrusion terrors tor CHANGED itiMiis 
on ti I I and oii'd I'lM a I I . For t\ic [i ot tlu^sc* measiirc»s» tlu^rc 

sliould bt* ti'v dittcionies to training cundition. 
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^la-t^Mials. Tlio materials \^*rt» nVnt u a I to tln)St» nscil in 
l.\|>r'i luifnl 1. Kai li ut the tiv<* target |)assagt»s containod IJ 
stnltMor^., ^ racli tliat uvrt> KKPKATKD. CHANGKI), ov l^NKKIAlhb vm I li 
ti»spi*tl to lhi\ irainuiK pass.igcs tlnil prt^itMltMl tluMU. 



Su bjects , One hundred UCLA undergraduates participated in the 
experiment) either for pay or to satisfy ^ course, requirement. 

Desig W. The same .design as in £xperinMnt V was used. The 

dependent variables were percent free recall and percent cued recall 
of sentences from the target passages. The number of training 
passages preceding a target passage (1, 2, 3, 4, or 8) and sentence 
type (REPEATED, CHANGED, or UNRELATED) weVe within--subject variables. 
Test type (free or cued recall) and re^entipn interval for the target 
passages (0 or 24 hours), were between*subject variables. The two 
groups defined by the two retention intervals will be referred, to as 
the 2A/0 group (24 hours i)etween presentation of the training and 
target passages, 0-hour retention interval) and the 24/24 group 
(24-hour training-to-target interval, 24-hour target retention 
interval). Each of the '100 subjects was ^randomly assigned to one of 
the four groups so that there were 25 subjects in each group. 

Procedure. The study and /test procedure was ^ the same as in 
Experiment 1. After studying to learn the training stories presented 
in booklets (Part I), subjects were dismissed and asked to return at 
the same time the next day. In the second session (Part JI), the 
intentional learning instructions were repeated. Then subjects read, 
the target stories as in Experiment K The 24/0 subjects tUen 
proct^edeil directly to Part lit, the recall test for the target 
stories. The 24/24 subjects were dismissed Gntil the next day, when 
tht^y rei onveneil for the recall test. The target stories were tested 
in tlie s«nne manner as in Experiment I. 

Rt;snlts and Uiseussjion 

The cued and I ree ret a 1 I resu Its were initial y ana I yzed 
st^parately using an analysis ot variance. Free recall p .cols were 
srortul as in ExperimtMit I. In cMch of the four groups (I: ^Lh free and 
I utMl rtH'all in the 24/0 «ind 24/24 conditions), the mean number of 
UNREli.yrEU items correctly recalled did not vary as a function of the 
number of prior training stories. ) Therefore, for each subject, mean 
performance on UNRELATED predicates' and details in both * retention 



conditixmt vas averaged acroisa the five training c(^iti«n8 (1, 2, 3, 

.4, 8) and treated as a zero .training condition, as in EXperiMent 1. 

The reauits for tree recall of entire aent«ncea are tuanMri%ed in 

Fig. 2.7.- Subjects recalled nqre on the iMnediate test (2^/6 group) 

l.han on the delayed test (24/24 group), F(l,'720) » 10. 12, £ < "^.OOl. 

The effect of number of training stories was also significant, 

F(4, 720) = 11.43, p < .001, as was the type of sentence, F(2, 720) = 
187 ."58, p < .001. Re9all of REPEATED sentences increased with 

^increasing nuiftbers of training stories on both immediate and 

delayed tests. As predicted, immediate recall H>f CHANGED sentences 

(the 24/0 condition) also increased monotonicallV with increased 

number of training, stories. Although this function was in the 

predicted direction, a planned comparison failed to confirm a linear 

trend in the data^ F(l, 144) = l/99, n.s. Recall of CHANGED 

sentences on the delayed test {74/24 cond^^ion) was depressed and 

coi^stant across training conditions. 

One nupthod for assessing the effect of the delay between training 
and target passage presentation on improving discriminability ^is to 
•4^ompare the CHANGED recall results from Experiments I and 2. Overal^, 
free* recall of CHANGED sentences in the 24/0 condition was superior to 
recall in the *0/0 » condition (no training*to-target delay), t(4) = 
t),72, p < .01. Moreover^ this superiority in recall was maintained 
atter a 24-hour retention interval. That is, recall of CHANGED 
stMitt^Uies in the 24/24 condition was reliably better than in the 0/24 
I inidit ion, t(4) = 2.39, p < .05. 

in ilelermine the effects on learning and recall of the CHANGED 

seiitentes in the 24/0 condition of Experiment 2, these recall data 

were broken Ai^w into predicate and detail recall graphs. These 

results are showiix in Fig. 2.8. CHANGED predicates were recoil led 

reliably better than details, F(l,288) = 9.69, p < .001, This 

rt^sult was (»xpected, since predicates presumably received more 

trequent activations, .uid hence were more accessible, than target 

details. For both predicate and <letail recall, performance increased 

with increajiing numbers ot training stories. Thjs increase was 

% 
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Fig.- 2.7 — Free recall of REPEATED and CHANGED sentences In 
' . Experiment 2 




Number of training ponogti 



Fig. 2.8 — Immediate friee recall of the CHANGED sentence 
^ constituents (24/0. condition) In Experiment 2 
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reliable, Ftr,288) « A.OO, g < .05.' Furthertnore , the interaction 
between itW-4y;^e (predicate or detail) and training condition waa^ not 
significant, F(5» 288) s 1.26, h.t. Thia failure to find a sig- 
nificant interaction is an inportant result for two reasons. 
First, it indicates that the sigW>H^ant increase in recall across 
training conditions it attributable to increases in detail recall as 
well as predicate recall* Second, ^this result iaq[)lies that detail 
recall is proportional to predicate recall, as predicted* Thus the 
increase in detail recall can be attributed to the increase in schena 
accessibility and the absence of negative effects of discriniaability* 
Additional support for this latter conclusion nay be adduced from 
the intrusion data for CHANGED sentences. It may be noted in Fig. 2.8 
that subjects virtually never intruded a detail learned during 
training into reca}! of target CHANGED sehtences. Furthermore, there 
was no Increase in the intrusion rate as the number of training 
passages increased. Thus the 2A**hour delay ^^)>e%Veen training and 
target presentations guaranteed ^tfiee^imili^lon of discriminability 
difficulties.^ 

The cued recall results for ^Experiment. 2 are shown in Fig. 2.9. 
As in free recall, performance was better on the immediate than on the 
delayed test, F(l, 720) 14*137 £ < .001. Cuet^ recall of details 
from REPEATED sentences increased with increasing repietitions provided 
by the training passages. This result was obtained in both the 
Immediate (24/0) and delayed (24/24) test conditions. As predicted, 
cued recall of ^HANGED details in the immediate test condition did not 
vary signif Icaqj^y /icross training conditions. Cued recall level was 
constant for 0 tot 4 t^ralning stories. Performance increased for the 8 
condition, 6ut ^ post-hoc Newman-Keuls test declared ithis difference 
to be unreliable (p > .10). To reject the" hypo^esls that the 
2A*hour training-to-target Interval did not ^^^^^ detail 
dlsi^riminability, the cued recall results for CHANGED sentences in the 
0/0 and 24/0 conditions were compared. Overall, cued recall was 
better in the 24/0 than in the 0/0 condition, F(l, 47) ^ 5.30, p <.05. 
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In • axldition, the decrease in cued recall across ^training con- 
ditions in the 0/0 condition produced a significant'! ^(^^^^^c^^<^> 
F(4» 188) » 2:50, £ < .05. . 

Intrusions of training details in .cued recall of CHANGED 
sentences on the ioiaiediate test did not vary significantly across * 
training Conditions. This result was as predictejl and provides 
additional evidence for the assumption that the training-to-target 
delay improved the discriminability bet«;een the- training and target 
details. 
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Fig. 2.9 — Cued recall of details, for REPEATED and CHANGED sentences 

In Experiment 
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GEKERAL DISCUSSION . 

. • 

These results pr,ovide tonsistent 8uppoi& for the proposed model 
of «e»ory scheaata. That i^del pretufies tjhat knowledge substructures 

0 ... 

are shared in oienory to encode information acquired in different 
contexts. The model rests an some basic , assumptions about the 
structure of these 'schemata in memory^ 'and -the processes that operate 
on them. The major assumptions and the results |^hat bear on those 
assumptions are briefly summarized below. 

1. The use of a schema or shared substructure ip^^^'S^numbier of 
unique contexts strengthens the rep^resenati^m of the shared 
information and increases its accessibility in memory. This 
prediction is common ^to many previoJl^8 theories/^ learning (e.g.» 
Hebb, 1949; Anderson & Bower, 1973). For both REPEATED and CHANGED 
sentences and in all retenti6n conditions (0/0, 0/24^, 24/0, 24/24), 
free recall of the shared information (the sentence predicates) 
increased With' increasing numbers of training passages. These 
training passages constituted repetitions of common information in pew 
contexts with either a single or varied .associates. 

2. When information from different contexts shares ihe same 
schema in memory, there is interference in learning an^retention^f 
the^ subset of the information thht is unique to each*T)f the different 
conrtexts. This interference^ increases with increasing numbers of 
competing associates to the schema. This predi6tion was confirmed by 
the data in the 0/0 condition for intrusions in both free and eyed 
recall of CHANGED details and by the data fos correct cued recall of 
CHANGED diTtails. The probability of correct cued recall of details 
decreased with* increasing numbers of other details competing for 
associations with the same schema. Intrusions of those competitors, 
on the other hand, increased across traifting conditions. 

3. The facilitative and inhibitory 'ef^cts of the use of 
schemata "^for learning combine to predict acquisition and retention. 
As a shared schema is strengthened^ through its use in multiple unique 
contexts, acquisition of information sharing that schema is initially 
facilitated, then inhibited, and . finally unaffected as . the 
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componential effects reach their Mximal valuer. la free recall of 
CHANGED sentences and CHANGED details in th? 0/0 condition, this 
prediction (shown in Fig. 2*3) was confinac^« As the number of prior 
trainihg passages increased, recall of CHANGED* items first increased, 
then decreased to asymptote. . % ' ' ^ 

4. The interference among coropet^ing associates to a schema can 
be reduced or eliminated b^ increasing the discriminability among the 
various contexts of occurrence of the competing information* When the 
presentation of the target passages followed the training passages by 
24 hours, immediate recall. 4»f CHANGED sentences and details (the 24/0 
condition) was improved relative to the no^delay condition (0/0) . In 
addition, the reduction of ^ (discriminability difficulties did Aot come 
at the expense of the facilitative effect of schema 'repetition:, 
Recall of CHANGED items increased with increasing numbers of training 
passages* . ' 

Our characterization ^of memory schemata addresses but a single 
level of complexity in what is shared and transferred* A sehema in 
this study was operatioifalized as a semantic predicate or relation and 
the associated case frames^ that instantiated the predicate* * The u^e 
of a schema in multiple contexts consisted of the repetition of sets 
of these predicates in different passages with either the same 
(REPEATED) or different (CHANGED) case fillers. Other researchers 
have studied the acquisition and transfer of both more and less 
complex schemata* 

Hayes-Roth (1977) predicted and obtained the combined transfer 

function in Fig. 2.3 using pairied-associate nouns as materials* 

« 

Subjects were given variable amounts of training on A*B pairs and were 
thea, trans ferreVl ' to learninrg of A-C pairs. A recognition test 
measured recognition confidence on A-C pairs as a function of A-B 
learning* At low levels ofs^-B learning, establishment of the A**C 
representat'ion benefited from the accessibility Of A / in memory* 
However, with increased strength of the A-B association, activation of 
A for use in A-C learning entailed the simultaneous activation of B, 
thus 'interfering with establishment of the A-C representation* In 



that study, the shared infornation was simply the noun A, but transfer 
effects simij^ar to the present ones were obtained. 

Thorndyke (1977) investigated \,tbe transfer of a much mote 
abstract learning sd^ma in a study of text memory* Subjects were 
presented a narrative text to learn for later recall test* 
According to a proposed theory of text learning, the comprehensid^n and 
assimilation of the text into memory required the use of a schema for 
story structures • that facilitateid the organization of simple 
propositions from the story into higher-order functional units. These 
units reflected the integration of the story information into a 
coherent knowledge representation of the plot and episode structure of 
the/narrative sequence as well as. the semantic content of individual 
propositions/ The to-be-learned stofy was preceded either by a story 
with unrelated cbntent but an identical narrative sch^ma^^or by a 
story unrelated in structure and content* It was postulated th.at in 
the repeated structure condition, the *story schema encoded during 
first-story^ learning could be successfully utilized for representing 
the to-l\gr learned story. In fact, this repetition produced a 
significant 22 percent improvement « in learning, compared to the 
control condition. Thus, with one prior learning trial on a story 
schema, positive transfer of. the schema to a new context was obtained. 
Similar effects., of proactive facilitation have been found using 
expository educational materials (Royer & Cable, 1975, 1976). 

The observation tha't multiple associations to a knowledge unit 
produce, ^interference is, of course, a well-established result. The 
hypothesis that multiple associates to a knowledge unit produce 
interference because of discriminability 4 difficulties was first 
proposed by Underwood (19A5). Recently, numerous researchers (Crouse, 
1971; Anderson & Myrow, 1971; Bower, 1974; Kuhara, 1976) have found 
retroactive interference in the recall o:^ detailed facts from pifose 
passages when the int^polated passages contain the same facLp with 
new details (as in the CHANGED sentences used here). In addition. 
Bower (1974) found retroactive facilitation in recall of information 
repeated in the interpolated passages either with the same or with new 
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associates (as in the REPEATED and CHANGED predicates used here) . 
However, none of these researchers predicted the . combined 
facilitation-interference function for performance that was obtained 
here for CHANGED sentences. 

One potentially important factor that was not manipulated in the 
present experiment is degree of learning of each individual CHANGED 
sentence. Hayes-Roth (1977) has argued that the qualitative nature of 
transfer effects (positive, negative, or null) is largelV/^^Sfetermined 
by the degree of learning of the training material. /Ln particular, 
she demonstrated that (1) minimally learned training material produces 
primarily positive transfer effects; (2) moderately well-learned 
training material produces primarily negative transfer effects; and 
(3) overlearned training material produces no transfer effects. These, 
effects presumably reflect changes in the availability of memory^ 
substructures fot use in encoding new information. In thie present 
experiments, all CHANGED training sentences were presented only once 
and were thus minimally learned. If the training stories had been 
better learned, the obsexved transfer effects might have been 
qualitatively different. Whether Or liot an injteraction would occuA in 
/the present paradigm remains an empirical question. 

Most of the attempts made to date to develop schema theory as 
viable psychological theory have focused on the representation o| 
well-learned schemata in memory (Rumelhart, 1975; Schank, 1975| 
Thorndyke, 1977, 1978; Rumelhart & Ortony, 1977) or the processes that 
V operate in conjunction with schemata during .comprehension or memory 
search (Norman & Bobrow, 1975; Bobrow & Norman, 1975; Rumelhart & 

< 

Ortony, 19770* To date, schema theorists have said little about the 
dynamics of andu constraints on the acquisition of new information per 
se* The tacit assumption of the class of schema, theories seems to be 
that new information^^ acquired by producing a copy (or token^ of an 
* existing schema in memory and "interpreting" the new information in 
terms of the schema by instantiating as many of the variable concepts 
as possible (cf. Rumelhart & Ortony, 1977). While this is a 
reasonable theoretical generalization upon our learning theory, it is 
as yet empirically untesi^d* 
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In contrast, Experiments 1 and 2 focMsed primatiXy on those 
aspect* of schemata that are relevant for the learning process. In 
essence, we have proposed a learning theory that coibines the new 
notions of memory schemata with som^ traditional psychological 
assumptions about learning. Our theory of schemata as shared 
knowledge structures is similar to other formulations of schema 
theory; however, it goes beyond them as a psychological theory by 
detailing the costs and benefits associated with the use of schemata 
in learning. i 
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III. KNOWffDGE ACQUISITION FROr NEWSPAPER STORIES • 



Chapter, II investigated the effects on leairni^ig of repeating 
shared knowiledge substmictures. Tfiis chapter investigates the 
relative efficacy of particular text organizations for learning. The 
influeaca of text t>rganizations on' the acquisition of infoi^ation has 
received extensive treatment by edudational and cognitive 
psychologists. In some studies, the investigators identify the 
learning objectives for subjects—that is, the subset of text? 
information to be sought and learned (e.g. , Gagne & Rothkopf, 1975). 
More typically, however, a reader attempts to learn all* the 

4 

information in the passage, since he does not kaow what particular 

facts will be of use later. In such cases , the structure of the 

material is a critical determinant of what will be learnecl from the 

passage. " In general, familiarity with Jthe structure of the maj^eriai; 

independent of its semantic content, can facili^^Xe learning, of the 

material (Thorndyke, 1977). j 

• Several studies have investigated the /efficacy of various 

information organizations for text learning. In a series of related 

studies (Frase, 1969b, 1973; Friedman & Greitzer, 1972; Myers, Pezdek^ 

& goulson, 1973; Perlmutter & Royer, 1973; Schultz & DlVesta, 1972) , 

text passages were constructed from matrices of namcj-a tpribute- va lue 

triples. That is, a set 6f concepts in a semantic category were 

described using a fixed set of .attributes , and each concept in the 

« 

category had different; values of the« attributes. In general, these 

studies demonstrated that'any coherent organization of the information 

(I.e., either by names or by attributes) produced better learning than 

a random organization, and that the two organizations produced equal 

learning^ * . ^ 

The texts used in these studies described a small, fixed set of 

♦ 

exemplars from a single conceptual category, with each exemplar 
possessing different values for a particular set of^ attributes: « More 



typically, a text that sonieone 'has to learn contains information about 
multiple topics^ has' a wide variety predications about those 

topics, and contains events or actions with a temporal structure. 
Traditional clas8ificM:ion systems segregate prose passages into four 
basic genres ::-'^'aescription, exposition, narrative, and persuasion 
(Brooks & Warren, 1972). Depending on the author's intention and 
point of view, texts of the first three type.s*are frequently organized 
either topically, ^j^ith information organised an/ound conceptual themes, 
or temporally, with information presented in a narrative sequence. 
Thes« two organizations might have very different ccmsequences for how 
well a passage can be learned, particularly if oiie of the 
organizations, is preferred by. readers. ' 

In studies of the effects' of these two forms of organization on 
learning (Sasson, 1971; Kulhavy, Schmid, & Walker, 1977), conceptual 
organization of information was superior to temporal organization. In 
the Sasson study, however, the textsWre presented 4?o subjects one 
word at a time in serial order. This, procedure bears little 
resemblance to the way in which people normally study and learn texts, 
so tronclusions from this study regarding normal processing modes^must 
be regarded as tenuous. In the Kulhavy et al. study, only recall of a 
few target words was measured, so it is difficult to asseTss <^e effect 
of the organization manipulation on overall learning of a coherent 
prose passage. 

In attempts to precisely model the organization of textual 
information . in memory, several researchers have proposed detailed 
representations for the structure in a prose passage (Kintsch, 1974; 
Meyer, 1975;' Rumelhart, 1975; Frederiksen, 1975; Thorndyke, 1977; 
Handler & Johnson, 1977). Various' predictions from these models for 
the influenc-e of structure on acquisition .and retention of information 
have been tested empirically. A typical finding is that the 
"central ity" or "importance" of a pro^sition to ^the "theme" of the 
'passage predicts the recall probability of the proposition (Kintsch, 
1974; Meyer, 1975; Thorndyke, 1977). From these and other studies, a 
general theory of "schemata" has emerged (Anderson, 1977; Rumelhart & 
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Ortony,' 1977; Thorndyke, 1978)* This theory assumes that a ipersoYi has 

in memory a set of prototypical < structures for use in comprehending 

and encoding prose information i particjalarly goal*directed narrative 

sequences. For narrative stories, these structures organize a 

temporal sequence of actions into a hierarchically arranged set <>f 

episodes that reflect ^elr cauises and consequences (Kumelharti ^ 19 75; 

Handler & Johnson, . 1977; \Thorndyke, 1977). A common assumption ^of 

these models has been that the easier it is for a reader to identify 

the underlying narrative and causal structure of a text, the better 
his comprehension and memory for the text will be. While .this 

"^assumption has received some empirical support (Thorndyke> 1977; Stein"* 

& l^ezworski, 1978), the text domains to which th^ schemata apply have 

been relatively narrow. Thus the generality of particular schemata 

has not been determined. It is unclear, for example, whether a . 

particular structure or schema is optimal for learning all narrative 

text.i, or whether numerous schemata could be equally effective, 

depending on subtle attributes of t*he to-be-learned texts. Thus* ajs 

in the name^attribute-*value studies discussed above, the' question of 

whether particular schemata can be idenvif led as' optimal for learning 
« 

is still unresolved. 

The present study attempted to assess the overall effect of 
various information organizations on t^e learning of meaningful, 
naturalistic texts, and to determine if an^optimal organization could 
be identified. If readers strongly prefer to .use a single narrative 
schelnsa^ to encode narrative passages; then a text preaentation format 
that I highlights the temporal ^ and causal dependeilcies among events 
should produce optimal learning.* . ^ 

The source of matero^als for the experimental stimuli in^ 
Experiment 3 was newspaper stories. Several current events and 
feature stories were selected from the New York Times and the ^s 
Angeles Times to serve as fact* bases to be learned by subjects. -The 
newspaper was used as a text source because naws ' stories provide a 
naturalistic processing ' environment. People frequently read and use 
newspapers as^an information source. F^rthermore-j news stcrriesc appear 
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already organized in a standard, familiar format , so the utility of 
that format for learning .can be contrasted with other experimentally 
'lSipt)sea~brgajp^a Th'e~8taadard~8Tructure of news stories- "the 

presentation of/ "important" or "timely" 'information in the first 
paragraph and the elaboration of details and background in subsequent 
paragraphs — is» based on conventions of journalistic style* Important 
information is presented first so that it will catch the reader's eye 
aftd-~^i^._a_s.sjjiiilai«d^ 'a^^ a quick glance* Information is presented in 
generally decreasing order of importance so that if the story needs to 
be cut to fit a particular space on the page, the material that is cut 
oyt will be less important than what is left in* Thus, the 
rganization o^ the news story is dictate\l by *the particular 
requirements of that medium. However, this structure may not be 
optimal for the learner attempting^to- acquire all the facts in the 
passage. News stories present events out of their normal time 
sequence and utilize repetition ^dT^^undancy in order to establish 
referential connections among, facts that are related but are widely 
separated in the st6ry* ThUs, while certain goals of the newspaper 
editor are met, they might decrease the overall learnability of the 
material . • * 

In tills chapter, the efficacy of alternative ''presentation formats 
for learning; is assessed. In Experiment 3 subjects read and* then 
recalled stories presented either in news format, standard narrative 
org4.ai/apio(i, or a topical organization. Mea%U£^ of reading time for 
each passage were taken in each organizational format to provide some 
indication of the readability of each organization. If subjects 
prefer to use a narrative jschema to comprehend and learn stories, then 
the narrative text organizations should produce faster reading times 
and higher recall scores tlian the other familiar organizations. 

Method 

Materials. Four newspaper articles from the Los Angeles 
Times *^nd the New York Times were selected for use as materials. 
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Each article described a set of events that oci;urred over a period of 
time and background informatioa relevant to tho^e ^ents. The text of 
one 8uch story is provided below aa an illuatraiion of the NEWS, 
organization. 

« * • 

Iraq: News SjLory 

Despite having the second largest oil reserves in the Middle 
East^ Iraq today finds itself short of cash. 

Civilization was cradled between its Tigris and Euphrates 
rivers, and the site of ancient Babylon* s splendor lies 50 
miles south of Bagdad. 

^et the majority of Iraq's people were illiterate as late as 
1973. ' 

il revenues have increased massively in recent years , but 
only a small minority have benefited, in contrast to other ^ 
petroleum*producing Arab lands where spread-the^wealth has 
w. been a byword. 

***Our problem is management management from top to 

bottom/* said Dr. Hashim Jawad, a top planning advisor to 
Iraqis Revolutionary Command Council. 

Iraq once was a sleepy, British-oriented monarchy. 

Red double-decker buses still churA through. Bagdad' s crowded 
streets, and what remains of the old privileged class still 
gathers for tea or tennis at the Alwiyah Club. 

To this has been added the trappings of the turbulent 
post* revolutionary era, such as the splendid arch which is a 
monument to Iraq's unknown soldier, and a still-unfinished 
^ luxury 'hotel . 

Many projects such as this have been halted in midstream and 
others postponed because of the lack of cash. 

Iraq has an estimated shortage of $600 million in oil 
revenues this year, out of a total expected income of around 
• $8 billion. 

When the Basrah Petroleum Co., the' last jremaining Iraqi oil 
firm which still had foreign participation, was fully 
nationalized last spring, the former paremt companies halted 
their purchase of oil. 
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Gradually they have beak^coRiin^ back, with Shell and the ^ 
French Petrbleutn Co. the first to resume^ 

Last April, Ir'aq suddenly cut off all oil shipiqents to 
MediterMm^w trans^Syfiim^'^Qiell^ • 

Early this ye>t^^ another pipeline to the Mediterranean, 
which bypasses Syria and ends up in Turkey, is scheduled to 
become operational. 

This shoi^ld fully make up for the capitity lost by shutting 
down the trans-Syriafi pipeline. 

The present set of rulers here is the third since the 1958 
revolution which ended the monarchy. 

That revolution set the country off on a new course, vaguely 
socialistic^^d-^trongly Arab nationalist. 

The Soviet Union is now Iraq's major friend, and Zionism is 
the c^nemy^ » 

A lack of manpower and skilled technology is the major 
problem. 

This story concerns the declining oil revenues of Iraq, the 

causes for the decline, and the prospects for the future. However, 

many of the sentences in the story are either tangential or iri'elevaijt 

to this theme. In addition, some of the sentences are repetitions or 

* 

elaborations of information presented earlier* ' \ 

A^g^cond version of this NEWS organization, called the CONDENSED 
organization, was constructed- The CONDENSED brganization of each of 
th^ tour newspaper stories was derived from the NEWS passages by 
deleting certain information from them. Deleted information was of 
one f three types: (1) repetition or elaboration of previously 
presented information; (2) background information that was irrelevant 
or tangential to the main point of the story; or (3) extraneous 
commentary on the events of the story either by the reporter or by 
another observer. Background information was considered to "be 
tangential if it was neither referred to nor presupposed by subsequent 
statements. Thus the important information from the story was 
preserved, while the unimportant information was eliminated. The 



serial position of. the renaming sentences in the story was not 
altered. A portion of the CONDENSED versio/i of the Iraq story is 
given below. . ^ * ^ \, 



Iraq: CONDENSED Version 

Despite having the second largest oil reserves in the Middle 

East, Iraq today finds itself short of cash. ' 

■ $ 

Iraq once was a sleepy, British-oriented monarchy. 

Iraa has an estimated si)ortage of $600 million , in oil 
r^eVj,ue8*"'this year, out o{;s.a total expected income of around 
$8 billion. \ 

When the Basrah Petroleum Co., the last remaining oil firm 
which still had foreign participation, was fully 
nationalized last spring, the former parent companies halted 
their purchase of oil. 

Gradually they have been coming back, with Shell and the 
* French Petroleum Co. the first .to resume. 

^ L^st "April, Iraq suddenly cut off all oil shipments to 
, Mediberranean ports Via a trans-Syrian pipeline.... 

The CONDENSED version of each nev£3 article was used t© create all 
of the other organizations used in' Experiments 3 and 4. One of these, 
the *NARRATIVE version, .was constructe^by rearranging the sentences in 
th^ COND'ENSED organization into a chronological sequence. Thus this 
passage preserved a temporal continuity in the presentation of the 
story*s events. A portion of the NARfeXTIVE version of the Iraq news 
story is presented below. ^ ' y 

Iraq: NARRATIVE Version • 
Iraq once was a sleepy, British-oriented monarchy. 
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The present •et/of rulers here is the third sinqe the 1958 
. revolution which ended the Monarchy. 

That revolutioii set the country off on a new course, vaguely 
socia listic and strongly Ara b nationalist.. 

The Soviet Union is now Iraq's major foreign friend, 4ind^ 
Zionisa the eneiay. 

• 7 ^ 

Iraq has the second largest oil r^S££^ in the Middle East. 

Last Spring, the Basrah Petroleum Co., ^ the last remaining 
Iraqi oil firm which still had foreign participation, was 
fully nationalized. 

As a result, the former, parent companief€ halted their 
purchase of oil. 

G£adually, they have been coming back, with Shell and the 
French Petroleum Co. the first tjjp resume. , 

Then last April, Iraq suddenly cut off all oil shipments to 
Mediterranean ports via a trans-Syrian pipeline 

Finally, a TOPICAL version of each story was constructed by 
organizing the sentences from the CONDENSED version under topical 
subheadings. A portion of the TOpCAL passage is presented helov^ 

Iraq: TOPICAL Version 

Oil Economy < 

Despite having the second largest oil reserves in the Middle 
East, Iraq today finds itself short of. cash. 

Iraq has an estimated •^UuiUage of $600 million in oil 
r&venues this year, out of a total expected income of around 
$8 billion. ... 

« 

History 

Iraq was once a sleepy^ Bri.tish-oriented monarchy. 

When the Basrah Petroleum Cov^ the last remaining oi-1 firm 
which still had foreign participation , was fully 
nationalized last springy the former parent companies halted 
their purchase of oil.... 

V , 
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Politics 



Lsit April, I ra(i 'suddenly cut off all oil shipnents to 
Mediterranean potts via a trans-Syrian •t>ip«line. 

This action served as an IraqT^rotest, of S^fia^ ,ia;^litary 

intervention in the Lebanese civil war> , 

Subjects . The subjects were 60 UCLA undergraduates. They 
participated in the 90-aiinute experiment, either to satisfy a course 
.requirement or for $5.0Q pay. 

Design . A Latin-square design with repeated measures was used. 
There were four conditions of story organization— NEWS, CONDENSED, 
NARRATIVE, and TOPICAL. Subjects were randomly assigned to one of 
four gr^ps, with 15 subjects in each gr*up. Each subject received 
one passage in each of the foux; orga]^izations« The four topic stories 
were entitled Iraq (the stOry presented above). The Release of 
Carrillo (concerning the prison release of the Spanish Communist Party 
leader), Wernher Von Braun (concerning the career of the rocket 
scientist), and Burundi (concerning the civil war in the African 
country). The assignment ofr stories to^ each organization, condition 
was counterbalanced across groups. The dependent variables were 
reading time and free recall of story propositions. 

Procedure. Subjects ' were tested singly or in small groups. 
Subjects were given booklets containing the stories, one story per 
page. They were instructed to read the passages carefully because 
they would be asked. questions about them later. They were instructed 
to read each passage only once and were not allowed to look back to 
previous stories. Each subject would read a story at a self-paced 
rate and then record the amount of time it took to read the story. 
Immediately after reading the story, subjects were instructed to write 
it down exactly as it appeared in wording and sentence order. 
However, they were told not to omit anything that th'ey remembered 
simply because they could not recall -/its exact wording or' serial 
position in the passage. Recalls were written on a blank sheet of 
paper, and unlimited recall time was provided. This read-recall 
procedure was repeated for each of the four stories. 
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Results and Discuasion 
^ .In order to analyze the reading tines and the recall protocols , 

i each passage was seyaented into_ propos itions, A proposition was 

defined as a clause or sentence which contained an action dr stative 
verb. Recall protocols were scored ^for gist' reproduction of the 
propositions. A proposition was scored having baen correctly 

9 rec^led if the relation or action in the propojBition was recalled or 
paraphrased correctly. ^ , 

The data were analyzed using a ^three-way analysis of variance 
that treated text structure, materi^s (story topic) ^ and subject 
group as main factors. Since there was no significant interaction 
between structure and materials for either reading time or recall, the 
data were collapsed across the different story topics within each 
structure condition. 

R eading time . The mean reading times for each of the structure 
conditions, are shown in the f irst ,row of Table 3.1. Mean reading *time 
for the original news stories was the longest (157.6 seconds), while 
that for^ the o^ther three structures was nearly equal. The effect of 
story organization on reading time was significant, F(3, 168) = 22.64, 
£ < .01. * Ne.wman-'Keuls ^ests were used to perform pairwise 
comparisons between the means. Reading time was significantly faster 
for the three other organizations than for the NEWS organization 
(£ < .01 for NARRATIVE and CONDENSED; g < .05 for TOPICAL). No other 
pairwise differences were significant. That the reading time for the 
NEWS passages was the longesjt was not surprising, since these passages 
contained more prop<)sitions than did those in the other conditions. 

To correct the reading times for the differences in passage 
length, each reading time was normalized by dividing it by the number 
of propositions in the passage. Thus for each condition, a mean 
reading time per proposition was obtained. These data are shown in 
the second row of Table 3.1. Mean reading time per proposition was 
actually fastestx in the NEWS condition, followed by the NARRATIVE^ 
CONDENSED, and TOPICAL c^nd^itions. This result was significant, 
F(3, 168) = 3.78, p < .0^. The NEWS reading time was sig- 
nificantly faster than the TOPICAL reading time i *wman-KeuIs| 
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Table 3.1 

READING TIMES AND RECALL PERCENTAGES FOR 
TEXT ORGANIZATIONS IN^IXPERIMENT 1 



. Factor 

Reading time (sec) 
Reading time per 

proposition (sec) 
Free recall (%) 



Structure Type 





. CONDENSED 






NEWS 


NEWS 


NARRATIVE 


TOPICAL 


157.6 


114.3 


108.9 • ' 


122.1 


2.10 


2.21 


2.12 


2.41 


18.8 


25.5 


24.7 


24. Q 



g ,< .05). Again, however, the mean reading tiii^e for the CONDENSED 
conditioQ dixi not differ from' t^t for the structural transformations 
on the CONDENSED condition (JIARRATIVE and TOPICAL) . 

Free Recall . The results for the free recall task are 
presented in the third row of Table 3.1, which gives the mean 
percentage of propositions recalled across the four passages 
for each text organization condition. These data were analyzed 
using the arcsine transformation on the percentages., Recall was 
lowest for the NEWS organization and higher and approximately equal 
for the other three organizations. The data were analyzed using the 
arcsine transformations of each subject's recall proportions, v The 
effect of organization on recall was significant, F(3, 168) = 
3.13, £ < .05. Newman-Keuls tests showed the mean for 
the NEWS condition to be s^ignif icantly lower than the mean for 
each of the other, conditions (£ < .05 for all three pairwise 
comparisons). The CONDENSED, NARRATIVE, and TOPICAL conditions did 
not differ reliably. It, may be noted ifthat while these . three 
organizations all contained identical passage content, the NEWS 
passages contained additional propositions not included in the other 
organizations. Therefore, not only were the NEWS texts longer, but 
the to-be-recalled information in thiera was not identical to that in 



the other three conditions. Consequently, the analysis of the recall 
, ■ • " - <■ . ■ ■ 

data was recomputed using for the NEWS condition only those 

propositions that occurred in the other organization conditions. When 

only this subset of the 'NEWS propositions was considered, recall was 

^22.0 percent. Using this scoring metric, the overall effect of 

, organization was not significant, F(3, 168) = 2.55, However, a 

planned comparison revealed that the mean ^or the NEWS condition was 

reliably lower than the combined mean for the o.£l^r conditions, 

t(168) = 1.74, e < .OS- ' , ' 

The fact that recall of the NEWS passages was lower when the 
extraneous NEWS propositions were scored than when they were not 
suggests that these propositions were not well recalled* A separate 
analysis was performed to compare mean percentage free recall within 
the NEWS organization for those propositions that occurred only^ in the 
NEWS passages (i.e*, the propositions that were deleted to. create the 
CONDENSED organization) versus those propositions that occurred in all 
OTganizations • Overall, mean recall of the former propositions was 
1'2.0 percent, while recall of the latter was 22 •O percent • This 
difference was significant, t(59) ='5.42, £ < •001» 

The finding that recall of the extraneous N£WS propositions was 
poorer than recall of the propositions used in the CONDENSED condition, 
is consistent with the hypothesis that these ejctraneous propositions 
were not central to the theme of the passage « When reading the NEWS 
passages^ subjjects presumably evaluated .the "importance" or ^ 
"centrality" of each proposition^with respect to the main theme of the 
story. Those. that were tangential or unimportant were not processed 
as deeply or as carefully as the more important propositions and hence 
were not learned as well. Ijhis effect of prepositional importance on 
recall has been obtained on a variety of prose materials (Kintsch, 
1974; Meyer, 1975; Thorndyke, 1977). 

This analysis rAay also be ' used to explain the obtained 
reading-time results. While recall was^ worst for the NEWS condition, 
the reading time per proposition for thia condition was the fastest. 
It is ^ai^ticularly surprising' that the mean propositional reading time 



fof the NEWS coflffition (2.10 ^conds) was faster than that for the 
CONDENSED condition (2.21 secondjs), since thes« conditions were 
identical ei^cept for the extraneous NEWS propositions that were 
deleted in the CONDEliliED coSidi^x)nr'^ possible explanation for this 
difference in reading t^me is that the extraneou^ ptropositions in the 
NEWS condition were scanned faster than those propositions that were 
common to the two conditions.. Since subjects were reading to learn 
the' passages , scanning time includes reading time^ comprehension time, 
and time for elaborative processing for\ encoding in memory. If 
subjects identified the extraneous propositions as irrjelevant or 
tangential to the theme of tha passage^ they xould process them more 
superficially and hence faster than the more important ones. If the 
propositions common to the NEWS and CONDENSED conditions were 
processed at the same rate in the" two conditions, while the extraneous 
propositions in the NEWS condition were processed faster^ then the. 
mean reading time per proposition in the NEWS condition would be 
faster — which, in fact, was the case. w- ^ 

While all structural transformations on the NEWS passages led - to 
improved recall performance, neithfifc. the NARRATTIVE nor the TOPICAL 
pas^sages were read faster or recalled better than the\ CONDENSED 
passages. This result suggest.s that neither .organizatjion provided a 
preferred, familiar schema^ that could be used to guide comprehension 
and encoding of the facts embedded in those structures. Experiment 4 
investigated whether this result could be replicated with andther 
^performance measure, question-answering, and with another 
organizational format. A TOPICAL organization was added to further 
highlight the narrative organization of the passages. 

The design of Experiment 4 was similar to that of Experiment 3 
except that the NEWS and TOPICAL organizations were deleted and an 
OUTLINE organization was added. The OUTLItfE organization was created 
by reorganising the material in the CONDENSED organization into an 
outline format, where events were chunWed into episodes according to 
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temporal «nd causal associations among them. An episode thus 
consisted of. a set of events and their consequences that were causally 

and 'topically related and that occurred together in tiije. The 

• .•^ 

episodes were ordered chronologically. 'This organization is similar 
to that found in several • psychological, models of narrative story 
memory; (Rumelhart, 1975; Thorndyke, 19^7; Handler & Johnson, 1977) • 
In the present experiment, however, this organization was made 
explicit by presenting the information in the physical layout of an 
outline. Information was spatially arranged on the pa^l^using 
indentations to .accentuate the hierarchical nature of the 
organization, explicit labels (e.g.. Background, . Episode^ 1 ^ etc.) were 
given to section headings, and. the text from which the outline was 
derived (the CONDENSED passage) was abbreviated so as^ to be amenable 
to the outline format. This alteration of the text itself Required a 
certain amount, of syntactic reduction of sentences, but no semantic 
alterations^ to the information were made. A portion of the OUTLINE 
organization for the Iraq text is presented below* 

J' 



BAI^GROUND 
Iraq 

CHRONOLOGY 

Episode 1; 
V Event: 
N^Result: 



Episode 2: 
Event : 



Result : 



Iraq: OUTLINE Orgini zation 
Was a sleepy, British-oriented monarchy 



1958 ' . 

I^evolution ended the monarchy 
Country set off on a new course , 

vaguely soci^^list 

and strongly Arab nationalist* • 

Last spring . 
The Basrah Petroleum Co., 

the last remaining Iraqi oil firm 

which still h^d foreign participation, 

was fully nationalized. 
Former parent companies halted purchase of 

oil « . * . 



Episode 3: 
Event : 

Result: 



Last April 

Syria intervened militarily in the Lebanese 
civil war. 

Iraq cut off oil shipments ^ 
to Mediterranean ports 
via a trans-Syrian pipeline.... 



1 . • . • 

Methy d ' . . ^ ^ ; ^ ' . . . 

Subjects . The -subjects were 45 ♦ undergraduates ' at UCLA vho 
participated in the experiment to satisfy a ceurae requirement. 

Deaign. , A ' Latin-square design with repeated measures was. used. 
There ^ere three conditions - of passag;e organisation- -CONDENSED, 
OUTLINE, and NARRATIVE— and three of " the topic p'assages, fr^im 
Experiment 3 were used as materials (Iraq, Burundi, and The Release of 
Carrillo). Ea'ch passage had three versions, one fox each 'of. the 
different organization conditions."* ""Each subject received for study 
and t^st a passage in each of the three organizations. Th^ assignment 
of story topic to organization wa's counterbalanced across' subject 
groups, as' was the serial position of' presentation of each', 
organization. 

There were two dependent variables. The first was free recall of 
the entire passage, . as in Experiment 3, and the second was 
question-answering performance. For each > passage, a set of 12 
questions were constructed whose answers depended upon retrieving a 
particular detail from the passage. Answering the questions correctly 
required only retrieval of explicitly presented, facj;s; no inferential 
processes were required.. For example, one such question for the Iraq 
passages was "What is Iraq's^ major natioji'al' protllem?" 

Procedure . Subjects were tested^ingly or in small groups. 
They were instructed to attend carefully to the passages because they 
would be required to recall them later^^ They were permitted to read 
each passage only once and could not Iqo^ back to previ^ous passa^s. 
After reading all three passages^ suljjects performed the free recall 
task. Recall instructions identical to those in Experiment 3 were 
given. Order of i^call of the? ' passages was the same^as the 
presentation order. 

The question-answering test i^ujediately followed' the. free recall 
test. Subjects weVe instructed to answer the questibns as well as 
they could, using the information they could rdcall from the story^. 
Twelve questions or sentence cooOpletions were presented for each * 
story. Questions from each story were listed on separate p'^ages, and 
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test order for the iJlssages was the same as, presentation order. 
Unlimited tine for answering questions was provided. 

Results and Discussion 

The same procedure as that described in Experiment 4 was used . to 
score the recall protocols. The mean percentage free recall and 
questions correctly answered were computed for each story in each of 
the three organizations. These data were%alyzed separately using a 
three-way repeated measures analysis of variance that treated stories, 
structure conditions, and subject group as main effects. The results 
are shown in Table- 3.2. 



FREE RECALL AND QUESTION-WwERING PERCENTAGES FOR THE 
TEXT ORGANIZATIONS ANB STORIES IN EXPERIMENT 2 ' 




CONDENSED 
NEWS 



Structure Type 
NARRATIVE 



OUTLINE 



Story 


Free 
Recall 


Question** 
Answering 


Free ' 
Recall * 


Question- 
Answering 


Free 
•Recall . 


Question- 
Answering 


Iraq, 
Burundi 
' Carril lo 
Mean 


23 
17 
27 

22.3 


* 3(S 
28 

40 ' 
34.7 


^' 33 
26 
19 

26.0 


52 
34 
24 
36.7 


It* 
23 
19 

22.0 


42 
44 • 
33 

39.7 



The pattern oi 'results^ was similar for • free .recall and 
question-answering. Across \subjects» there was a significant 
correlation between recall of a passage and the percent of questions 
correctly answered, r = .62, t(13^) = 9.11, £ < .001. For free re- 
call, mean performance was 22.3 percent for the CONDENSED condition, 
26.0 percent for the NARRATIVE condition, and 22.0 p^cent for the 



OUTHNE conditiojn. These differences were not significant. However > 

there* was' .a ► >4»ignif icant storyb^-structure * interaction, 

F(2, 84) = 3.70, g <r ,05» For the question-answering task, mean 

percent* correct was ^34,7^ fot the CONDEHSEI> condition, 36.7 for the 

JJARRATIVE c9ndition, and 39:7 for the OUTLINE condition". Again,, the 

results by organi2ati,on were not reliable^ but the story- 

byrbrganizatiori intm.raction was significant, F(2, 84) = 4.35, £ < ,05. 

iij Experiment 3, none of the organizations was consistently 
• ♦ 

superior for learning of the text information acros's stories. In 
« 

fact, the* interaction obtained *here for both free recall and 
qu*»sfcion-answering suggests that different organizations were optimal 
for different stories. An e>Kamination of the news stories used as 
materials in Experiment 4 revealed an obvious distinction among them. 
Both the Iraq and Burundi stories were essentially background or 
feature articles. They both contained a narrative chronology that 
provided a historical perspective for viewing the present socia and 
political situation in the countries. Neijther article conta) wd any 
current, newsworthy events; rather, they focused- on a broad history of 
events. For these stories, » then, comprehension of. the narrative 
sequence of events was critical to the theme of the passages. It is 
thus rea'sonable to presume that a . presentation structure organized 
armxnd the narrat ive^ chronology would facilitate* learning of the taxt. 
The Carrillo story, on th.e othei hand, was a more typical cutrent 
events story. It centered around a single events the release of 

3 

Carrillo from pri^son, and the multiple consequences of that event. 

There was much less * narrative history in ^ this story than in the 

others. Rather, the emphasis was on the implications in the present 

and in the fut'lire of the single, important action. For this story, 

ttxen, a structure, that ^emphasized the main event and its- direct 

consequences and deemphasized the background narrative might be 

preferable for iearninj^. > 

The ability of these hypotheses to explain the obtained 

interaction between structure and story was tested by computing 

• • • * . 

Newman-Keuls post hoc- linear contrasts o^ the means in Table 3.2. If. 
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a narrative structure was optimal for learning of the Iraq and Burundi 
stories, then free recall and question-answering pt ormanpe for the 
NARRATIVE and OUTLINE conditions should be bett^. than for ^ the 
COTOENSED condition. For the Burundi story, the rombiaed mean of the 
NARRATIVE and OUTLINE conditions was reliably, greater than for the 
CONDENSED condition for both free recall and question-answering (£ < 
.05 for both). For the Iraq story, the combined NARRATIVE and OUTLINE 
mean for question-answering was greater than that for the CONDENSED 
condition (p < .05). The comparison of free recall performance 
demonstrated the same trend but failed to achieve significance (g < 
.10). 

For the Carrillo story, the hypotheses given above^ make the 
opposite prediction. That is, the CONDENSED structure, with ils 
emphasis on the current event and situations of the story, should be 
superior to the NARRATIVE and OUTLINE conditions for learning. The 
same comparisons performed for the ottter * stories confirmed this 
hypothesis. I'or l)oth free recall and question-answering, performance 
fpr the CONDENSED condition was better than for the combined NARRATIVE 
and OUTLINE conditions (p < .05 for both). 

GENERAL DISCU SSION 

The results obtained here indicate that newspaper stories contain 
a considerable amount of information that is of little relevanc^^ to 
the reader or to the main theme of the story. A significant portion 
of this extraneous information is repetition of previously stated 
information that is necessary to establish referential identity for 
some new information to be presented. The repetition presumably 
facilitates comprehension by facilitating the integration of the new 
information with previously stated, or "given" information, as 
suKRested by Haviland & Clark (1974). Since a newspaper story employs 
frequent shifts among the set of topics it treats, much repetition of 
intormation is recJjuired to iderttify the changing contexts and identify 
the referents for the new information to come. Other extraneous 
intormation in news stories includes incidental background information 
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and coiwentary jthat is only tangentially related to the main pxri^t of 
the story. The recall data fron 'Experiment 3 indicate that none 6f 
this extraneous information is well learned relative to the more 
theme-relevant information in the story. The reading-time data also 
suggest the possibility that this information is not processed as 
carefully as the more theme**relevant information. These results are 
consistent with the general finding in prdse studies that people are 
more likely to learn and remember the important ideas (those central 
to the theme of the passage) than the unimportant ideas (Meyer, 1975; 
Thorndyke, 1977; fichert & Anderson, 1977). 

The recall data in the two experiments^ presented here complement 
previous work on the effects of various organizations on learning of 
textual material. In previous studies' using texts describing the 
values of various attributes for a set of concepts, no clear 
organization emerged as optimal for learning. In the present study, 
texts with more substantial variation xn content were used as 
materials. The to-be^learned information contained varying amounts of 
narrative history supj)orted by background information and discussion 
of the consequences of the historical events. While all the passages 
used in this study shared this general narrative form, no single 
organization was found to be optimal fo^ presenting the information in 
all texts. 

These results argue c-^-^inst the existence of a single, universal 
schema for representing all narrative texts. The notion of a *schema, 
as it applies to the representation of prose information, is generally 
iterpreted to be an abstract framework or description of how 
narrative information can be combined to produce meaningful stories. 
A narrative schema^ then, provides a set of constraints on how events 
and their consequences can be combined to produce meaningful episodes, 
and how a set of episodes, in turn, can be combined so they lead to a 
reasonable conclusion or resolution of the story. In this very 
general formulation, text schemata have been proposed to describe the 
structure of a story independent of its semantic content (Rumelhart, 
1975; Thorndyke, 1977). When a person reads a story, a stored schema 



in 
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is presumably i^ed to guide the comprehension of the story ;by inposiag 
the constraints^ oTi the schema on. the interpretation of the incoming 
information. When aVtory fits the stored schema^ comprehei^sion tfnd 
retention ate facilitate4 by the organizational and integrative 
benefits provided by the schema. 

In the present study, however, no^ single organization of 
information was optiraal for all stories. In fact, different 
» organizations were most effebtive with different stories. When tjie 
story^ contained a narrative chronology, ^the organizations that 
emphasized the causal and temporal associations among events produced 
the best learning. These organizations were suggested by earlier work 
on schemata for narrative stories (Rumelhart, 1975; Thorndyke, 1977; 
Mandler & Johnson, 1977). • However, when the to-be-learned story 
focused on a single event and its consequences, the newspaper format 
was superior to the narrative format as a text organization. The 
inability to find a ' consistently superior organizational form suggests 
one of twu conclusions. Either there are no real schemata that can 
characterize the organization of text information, or the»b roust be 
several (oi many) schemata that a person can effectively use, 
depending on the .nature of the to-be-learned information\ The first 
conclusion seems unwarranted in light of numerous studies that 
indicate people have no difficulty distinguishing'between stories with 
we'l 1- formed narrative structures and those in which normal conventions 
of causal and narrative organization are violated (e.g., Thorndyke, 
19 7 7 , Kuiisch, Mandel, & Kozminsky, 1977). While, these results do not 
prove the existence of scl^emata, theories based ^n such structures 
currently provide the best theoretical account for people's ability to 
recognize well-formed stories. Therefore, it would seem premature to 
argue against schema theory on the basis of negative results from a 
single study^ 

The more reasonable conclusion from these data would seem to be 
that people have available a set of schemata for text organization 
that can bt' used as the content of the text warrants. For example, if 
the narrative information in a story is only incidental to the main 
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poiDt "or conclusion, then a narrative schema, in which the events are 
assumed to lead up to and support the conclusion^^i^ay not be 
appropriate for encoding the storyV The main point, or focus, of the 
stdry would thus be central in determining the appropriate schema for 
encoding < the story information. In current events news stories, the 
main point is identified by its placememt in the first sentence or 
paragraph of the story. On the other hand, the focus in many stor'fes 
depends on the perspective of the reader. 6iven different 
perspectives on a story, different information might emerge as being 

central or impprtan^ in development of the theme. Other researchers 

. I. 

have begun to note circumstances in which alternative schemata may be 
applied to the comprehension of a story, depending on the perspective 
taken by the reader (Pichert & Anderson, 1977; Kozminsky, 1977). In 
these- studies, the information rei?ained from a passage by a reader 
could be influenced by biases in perspective introduced by the 
experimenter. These studies give credence to the notion that multiple 
schemata are available for us£^n encoding story information. For the 
multiple-schema theory to be useful and viable, it must be 
demonstrated that there are many fewer schemata than there are 
possible stories. That is, while there may be multiple scheiffata that 
can be used, to encode story information, each one of them nust be 
capable of representing numerous texts of its type. If the set of 
schemata are unable to reduce the universe of all texts to a small set 
of prototypical types of texts, then the theory is of little 
explanatory valued However, a substantial body of data have already 
been reported in support of a general schema for narratives, and the 
schema has been successfully applied to the analysis of numerous 
texts. It is not unreasonable to suppose that other general schemata 
for text organizat^'on could be identified and tested in a similar 
manner. 



IV. INTEGRATION OF idlQWlEDGE FROM TEXT 



I 

Chapters II and III considered factors determining the 
acquisition of individual facts from a text. However, knowledge 
integration is also a fundamental component of the 'Acquisition 
process. People do not simply acquire sets^'of unrelated facts. They 
integrate the facts they learn in meaningful conceptual structures. 
As a consequence > people can put separately acquired facts together to 
form new ideas. For example, a student might encounter the following 
two sentences at various points in a textbook dhapter: 

In 1850 » the Calediahs rebelled because the king had 

declared martial law. « 

The ISSO rebellion was suppressed. 

By integrating the information from those two sentences, the student 
could respond on a subsequent examination: 

There was a rebellion in 1850 because the king declared 
martial law, but it was suppressed^ 

Knowledge integration also provides a basis for inferential reasoning. 

For example, a person might reaci in the morning newspaper: 

« 

Mary Jones has been appointed Secretary of State. 

m 

and then hear on the evening news: 

Sam Smith has been named Special Assistant to Mary Jones. 



By integrating these two news items, the person could Ihfer: 



Saa Saith has been named Special Asaistant to the 
Secretary of State. 



Researchers have studied knowledge integr^ation in several 
paradigMs. Bransford and Franks (1971) provided the first 
experimental demonstration of knowledge integration. They showed that 
subjects could integrate the information in several related simple 
sentences to form a single, complex idea. Other researchers have 
demonstrated similar effects jf integration of constituent ideas 
(Hupet & LeBoudec, 1977; James, Hillinger, & Murphy, 1977; Park & 
Whitten, 1977; Peterson & Mclntyre, 1973). Similarly, many studies 
have shown that subjects can integrate several individual pairwise 
relations to form a single linear or* partial ordering of all 
constituent elements (Barclay, 1973; Foos, Smith, Sabol, & Mynatt, 
197^; Hayes-Roth & Hayes-Roth, 1975; Potts, 19^2, 1977). A third area 
of ^research has focused on the integration of information in 
successive sentences based on common referents (iJaviland & Clark, 
1974; Clark & Haviland, 1977; Garrod & Sanford, 197^^, 1977; Hupet & 
LeBoudec, 1977; Yekovich & Walker, inptess). Finally, a number of 
investigators have proposed theories to account for the representation 
and integration ^f knowledge in long-term memory (Anderson, 1976; 
Anderson & Bower, 1973; Kintsch, 1974; Rumelhart, Lindsay, & IJorman, 
1972; Schank, 1976). These theories assume that the memory concepts 
and relations in acquired facts are represented as nodes and 
associations in memory. Two facts are integrated in memory if their 
representations share a subset of nodes and associations. 

Previous studies have, in general, assumed that integration is a 
structural phenomenon that occurs during storage. . Successively 
acquired facts, are presumably appended to related existing knowledge 
representations. However, questions regarding when and how knowledge 

integration occurs have not been addressed. 



This chapter investigates the conditions under which integration 




occurs. We begin with a model of knowledge integration, based on a 
few assumptions about memory structures and processes. Many of these 
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assumptions appear in the previous research discussed above, 'and all 
JV4VC received pre^us empirical support (Hayes-Roth, 1977} 
HAyes-Roth & Hayes-Roth, 1977). The model provides a framework for 
predicting the conditions under which a given pair of facts will be 
integrated.^ 

We assume that the basic units for representing facts in memory 
are lexical. The meanings of lexical units derive from their 
aasociatave connections to other lexical units. Semantically related 
lexical units .are presumably more closely associated than unrelated 
lexical units. These assumptions imply that memory representations of 
facts that include identical wordings can include identical • 
subrepresentations. Memory representations <ff facts ' that include 
paraphrased wordings can not contain identical subrepresentations but 
may corftain associatively connected subrepresentations. Of course, 

< 

memory representations of facts that express unrelated information 
will have neither identical subrepresentations nor close associative, 
connections. . 

Memory representations can be "activated" in two ways. They can 
be activated directly, by apprehension of the information they 
represent in an external stimulus, or associatively via excitation 
received from other activated memory representations.' A memory 
representation can be activated more easily if (a) it has been 
activated recently;* (b) it contains a subrepresentation of information 
that is identical to information in an external stimulus; or (c) it 
contains a subrepresentation that is identical to one in an activated 
memory representation. A memory representation is more difficult to 
activate if (a) it has not been activated recently; (b) it contains a 
subrepresentation of information that is synonymous with information 
in an external stimulus; or (c) it contains a subrepresentation that 
i^ associatively connected to one in an activated Qiemory 
representation. Of course, a memory representation is least likely to 
be activated if the information it represe^its is unrelated to any 
information ^in an external stimulus or an activated memory 
representation. / 

■ —J 
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We assume that when two memory repriesentations are simultaneously 
active and contain identical or associatively connected 
subrepreaeiftations^ the two i^sj^esentations are integrated into, a 
single higher-order representation. In the case of identical 
9ubrepresentations, integration effectively "superimposes" the two 
representations' upon ,one another so that they share a single 
^ubrepresentan:Q n, ^ Thus^ — integrat ion — p1 imin a t es representational 



redundancy in memory for related facts. However, the integrated 

representation also preserves the identities of the original 

constitueRt representations. 'In the case of associatively connected 

subrepresentations, integration establishes a direct connection 

between the subrepresentations reflecting the semantic relationship 

> * * 

[between them but preserving their individual identities. 

Consider an example. Suppose a student studied a text describing 

the political organization of a particular country and encountered the ^ 

|followlng two facets: 

(1) The Domestic Welfare Agency^^^tttSTTibites information 
about professional options. 

(2) Information about professional options is distributed 
by means of computer terminals. ^ 

Facts (1) and (2,) share a common topic (the distribution of 
.information about professional optibns) and they present complementary 
details regarding that topic (that the information is distributed by 
the Domestic Welfare Agency and that it is distributed by means of 
computer terminals). The student could integrate the two facts as a 
sj.ngle "idea" that included all of the information: 

(3") The DomeHic Welfare Agency distributes information 
about professional options by means of computer 
terminals. 

According to the assumptions outlined above, simply learning (1) 
and (2) does not guarantee that they will be integrated. Successful 



integration requires 'the simultaneous activation of their 
representations. This activation could occur directly because the two 
facts contain ^identical wordings o^gponmon information, i.e,, 
"distributed information about professional options." Let^s consider 

. the memory representations that would result from either Vhe success 
or failure of the integration process. 

If the (1) and (2) representations were not simultaneously 

~axrtivated, — they — w o ul d have .-i ndeR e Ment represerita tj^ons > as shown in 
Fig. 4.1. For purposes of illustration, we have made a few arbitrary 
assumptions regarding the structural details of the individual fact 
representations. Figure 4.1 illustrates two important points-* First, 
the representations preserve the lexical constituents of the input 
facts. /Second, the two fact representations, remain unii\tegrated; that 
is, they share no common subrepresentations , and no direct 
associations connect them. (In a complete memory, indirect, 
ass^iations would connect these f^ct representations vi^ other 
representations defining their lexibJf^. constituents . We have omit'De^^^^^ 
the/se from Fig. 4.1 for simplicity.) \ . * . 

If the CO. and (2) representations w^rf simultaneously activated, 
they would be integrated in a single higher-order representation^ as 
illustrated in Fig. 4.2. The two f act^reprcser.tations have 
upon one another, so that they share a common subrepresfentation of the 
shared information, 'Mistributes information about professional 
options.*' Note, however, that the higher-order representation does 
not simply incorporate the constituent representations, obscuring the 
distinction between (1) and (2) . Instead, the higher-order 
representation preserves the distinction, as indicated by the solid 
and broken lines in Fig, 4.2. 

Now consider the case in which the student encountered the 
following instead of fact (1): 

(1*) The. Domestic Welfare Agency provides career counseling. 

^tegration of (2) witji the previously learned (1*) would depend upon 
simultaneous activation of the two representations. Because the two 
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DISTRIBUTES 



V OBJECT 



I INSTRUMENT 
^COMPUTER TERMINAL?) 



<^INFORMAT!ON^ 
\ QUALITY 

("OPTIONS ]) 

I QUALITY 

^PROFESSIONAL^; 



Fig. A.l — Non-integrated assemblies representing complementary 

facts (1) and (2) 




• Fig. 4. 2— Integrated assembly representing complementary 

facts (1) and (2) 
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facts contain paraphrases of common .'Information ("distributes 

f - 

inforaatioQ about professional options" versus "provides career 
counseling") this activation could occur only associatively/ In other 
words, activation of (V) during input of . (2) would require 
associative 'Chaining" based on the semantic relationship between the 
two paraphrases. ^ * 

If the (r ) and (2) representations wlere activated, 
simultaneously, they would be integrated in a single higher-border 

- Vep r^e s e n t a t , t ftn.^__as^ illjist rated in Fig. 4.3. Be cause the common 

inforroatir^ir ^ is paraphrased in the two facts, the^wo r^Tes^nt^ftions — 
have no sharable subrepresentations and cannot be superimposed uppn 
one another. Instead, integration is accomplished by encoding^ the 
semantic equivalence of the common information as an equivalence 

" relation between the two synonymous subrepresentat^ions. 

As discussed in these examples, integration of (1) "^(or 1') and 
(2) presumably occurs only if the two fact representations are 




f DISTRIBUTES 



' OBJECT 



\ 



I 

I C INFORMATION^; • 

I r I 

'QUALITY I 

. I 
' COPTIONS; I 

1 'QUALITY ; 
\ ^ — -I ^ ' 

V('' professional"')/ 



computer ^, 
terminals 



FLg« 4,3 — IntegratcO assembly representing differently 
worded complementary facts (1^ and (2) 



activated, sinultaneously. Two factors influence whether or not 

sinultaiieous activation occurs. The first factor is the recency of 

activation of ' the (X) * representation. As the time since the most 

recent activation of iV) increases, the probability of its activation 

when (2) is encountered decreases. Therefore, the probability that 

* I • 

integration will occur ^decreases. The second factor is the 

correspondence between inforffiation in the two facts. Rej»resentations 

of facts containing identical wordings of common information, such as 

(1) and (2), can activate one another directly. Representations of 

faces containing paraphrases of commen information, such as (lO and 



(2) , must aTttvate-^tme--^m0tJier„,ass^^^ Therefore , simultaneous* 

activation and successful integration are more likely Tn"TEeToi1iier~ 

case than in the latter. ' . ♦ ' 

The following experiments investigated these predictions. In 

these experiments, the two factors of interest were operational ized as^ 

binary variables. Thus, reldte^l facts occurred either consecutively in 

a single story or in two different stories. Similarly common 

information in related facts was either worded identically or 

» ' • ^ . * 

paraphrased. Of course^, if one could quantify the proximity between 

related facts or' the similarity of their wordings, one could 

presum^abty predict the magnitude! of the effects. Howeve^, ng effort 

was made to quantify 'these variables, and therefore /only * the 

qualitative nature of their effects will be evaluated. ^ /' 

EXPERIMENT 5 ^ » 

Experiment 5 ^tested these predictions in a task re'quiring 
subjects to integrate two facts in memory. The facts provided 
information necessary to fill different slots in a single case frame, 
as illustrated by (1) o,: (T) and (2) above. Subjects were presented 
pairs of related facts embedded in meaningful stories and were then 
tested on their ability to integrate the related facts. 

A matching test measured subjects' ability to identify pairs of 
case fillers from different facts^ that shared the same case frame. 
Matching of case fillers was petformed in the absence of explicit 
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case-frame cues (information common, to the related facts). For 
example, subjects were tes^Led on .their ability to identify •'Domestic- 
Welfare Agency" and "computet terminals" as the agent and 'instrunieut 
from a single case frame. The case frame itself ("distributes' 
information about professional options" )" was not given on the test. 

In performing' tjie matching task, subjects presumably could 4ise a 
given case filler to activate the memory representation in which^ it 
occurred- If that representation were pgrt of an integrated 
representa3:ion of all facts involving the case frame its activation 
would provide access'to all other associated case fillers, that is,, 
those that were appropriate matches- If the activated representation 
were not part of an integrated representation, the subject would have 
-tt) — tiie ^activated case-frame subrepresentation as a cue to 
associatively activate a second knowledge representa4; ion in which the 
same or a semant icall.y equivalent case frame occurred .in order to 
locate other associated case fillers. Because of the additional 
processing required in the latter case, retrieval of case fillers 
should be less likely and performance, on the matching te'&t should be 
worse. 

On another task, subjects were cued with case frames they had 
seen previously (i.e*, information common , to the related facts) and 
were then asked to identify the pairs of. case fillers occurring in 
that case frame from a long list of ^alternatives. In performing this 
multiple-choice task, subjects presumably used the case-frame cue to 
activate representations in which it occurred. If the case-frame cue 
occurred in an integrated representation, activating it would also 
activate al^^of the associated case Tillers. Subjects could then use 
this information to select the appropriate responses to the case'fram? 
cue from the list of alternatives. If the case frame cue occurred in 
two independent representations, both of them would have to be 
activated in order to retrieve all associated case fillers. Again, 
btnause ot the extra processing required in the latter case, 
activation of all case fillers should be less likely and performance 
on the multiple choice test should be wor*? than when the fillers were 
stored in a single integrated representation. 
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' Two Independent variables were manipulated to ^influence th 
probability that related facts would be integrated. Related, fact 
pairs such as (1) and" X2) occurred either consecutively within a 
aifmle story ot\ in Uwo different" stories. Accordli^g to the 
assumpt lOUh outlinVd abov€^> consecutive' occurrence of the two f9Cts in 
a singlg story should tacflitatc integration-^^ tLu;s , performance- 6n 



the matchinjj and cued recall tasks should be betker in the one-story 

.condition -.han in the tWo-i^toiy condition. Pairf» of related f^acts 

also varied in the wordings of common infonnation. Conmion information 
was either wOrded idtfntically or p'araphrased^ as illustrated by the 

pairing of either (I) or Q*) vyith (a) above. According to ithe 

assumptions outi Lned above, ixientical wording of. the common 

information should facilitate integration. Thus , "^perf ormance on the^ 

m.)tchinfe aatf ' cued-pecal 1 /asks • , should . be better in the 

idt^at jcjl-wordmg condition than in the paraphrase condition. 

Ttu^ 3S:iumptions also predict an interact ioo between the effects 

of number vt stories and wording of the common information/ In the 

one-story condition^ consecutive presentation of related facts should 

a 

tacilit jte bf)th .direct and associative activation. This facilitation 
may he strong t.nough that identical wordings of common information 
provide no. addi t ional advantage. Therefore, the wording manipulation 
^'should have a Relatively small effect in the one-story condition. In 
the f^wo-story condition, on the other hand, both direct and 
dissociative matches are less likely to occur. In this condition, 
identical wordings of common information should facilitate direct 
activation and, hince, integration. Thus,' while the effect of the 
wording" manipulation should l>e . relat.iveiy small in the one^story 
condition, it should be relatively large in the two-story condition. 

Method 

Materials. Three sets of meaningful stories \were 'constructed. 
Kach set consisted of. three stories about a different mythical 
country, and each story within a set was about a different aspect of 
that country. Six pairs of related 'facts and six unpaired and 
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unrelated ..filler facts were equafly distributed among the three 
stories in ea.ch set. Each pair of related facts contained information 
necessary to fill different slots in a single case frame, as 
illustratkd . in (1) an^ (2) above. Four versions of these materials 
were used' lA Experiment 5. In the one-story condition, the two facts 
constituting^ a related pai'r occurred consecutively in a story. There 
were two such pairs in each story within the set of passages for a 
given country. In the two-story condition, the constituent facts in 
p.Jir occurred in different stories within a set. Two of the related 
pairs had constituents in Stories " 1 and 2 in the set, two had 
constituents in Stories 1 and 3, and two had constituents in Stories 2 
arm 3. 

In both the one- and two-story conditions, each pair of related 
tacts had either the identical wording or a paraphrase of common 
intormation, as shown above by the alternative pairings of (1) or (T; 

vith..(:M. As .V i 1 lii.<.i.V.»tion of these materials, onn set of stories 
ext'ujpl i t\ II K I'U' Pleat ic.il "WjiVli lies r,wo-st6ry condil,..ii is presonLtMl 
below. 

• Brownland 1 

In Brownland, the work of the government is di- 
vided among several different bureaucratic agencies. 
Some ot the agencies and their responsibilities are given 
below. The National Intelligence Group col lectsdata 
regarding the international superpowers. The Navy attackr/ 
enemies of Brownland. The Board of Banking studies supply 
and demand fluctuations in order to prevent fiscal 
iri.«;es. The Royal Knowledge Society monitors scientific 
investigations in universities. The Internal Guard uses 
negotiations to deal with civil riots. The Domestic- 
Welfare Agency distributes information about professional 
options to all citizens. 

» * , 

Browniaud 2 

(.ove rumen t activities in Bruwnlano aie • undertaken with 
particular purposes in mind. A represent^j^ive sample ot 
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.ictivities iuid purposes is given below. The movement of 
citizens within Biownland is reported to the 
StaiibLics Department in order to minimize census taking 
difficulties. Spying operations are undertaken primarily to 
evaluate the likel ihood that Brownland will be 
invaded. The . government collects data regarding the 
internat ionii » superpowers in an effort to anticipate 
major disruptions. vScientific invest gations in 

universities are monitored so that important findings can be 
made available tc the government. The state keeps track 
ot the wealth of individual Citizens in order to 
f.icilit.ite ec nonjic planning. County agents maintain 
P<MmanenU iihs of al I viol at ions oi the law so that 
rop*'at ot tenders can be punisnrd. 



Brownland 3 " 

Tlu* Brownland government mokes use if various kinds 
of eijuipment and personnel in carrying out i t.^ 
titiutions. Some of these ure described lelow. Social 
workers .are used to insp.re that children are given 
adequate home environments in oider to promote an 
egalitarian .society The \Lce squad uses electronic 
surveillanie equipment to detect crime the streets at 
ni^ht. Long range missileb are used to attack enemies. 
Spying operations utilize paratroopers. Information 
abuut protessional options is distributed by means of 
c(Mnputer terminals. The state keeps track of the wealth of 
mdi virtual ( itizens by means of ID cards. 
I 

Subjects. Sixty-four IJia.A undergraduates participated in the 
»Mio-hoiir t'xperimeiit . Subjects were either paid $2.50 or given course 
< i^dit for participation.. 

l)/nsi^ji. \ 2x2 hetween-subjocts factorial design was used, 
rfv* location pf pair constituents (one-story versus twc-story 
conditions) was. crossed with wording of the constituents (identical 
versus paraphrase) to produce four experimental conditions. Subjects 
were assigned randomly to, one of th^ four groups. 

^^/^5.?^.y.r?-' Subjects were tested in groups. Each subject was 
given a booklet containing the experimenta 1 stories and tests • 
Subjects* progress through the booklets was self-paced. 

Subjects studied and were tested on each set of three stories as 
follows. They read the first story ca-refully; then they performed a 
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cued recall test for- facts from the story; then they looked back at 
the story to check their answers and study t^ny facts they missed. 
This read-recall-ct\eck procedure was repeated for each of the three 
stories in the set. 

•^en subjects were given a matching . test. Two lists were • 
presented, each of which contained the case fillers from all of the 
facts in the stories, ^or exanfple, the lists for Brownland included 
the following two items: "Domestic Welfare Agency" and "computer 
terminals." One of the lists had a blank space preceding each item; 
the other, had the items numbered. The subject's task was to indicate 
which items occurred in the same case frame by writing the .numbers of 
items from the numbered list in the blanks preceding the corresponding 
constituent fillers in the other list. 

After completion of the matching task, subjects were given a 
multiple-choice task. Subjects were cued with the subsets of 
information common to facts in a related pair (e.g. ."distributes j 
information .sb.nil professi.vnal options"). Only one of - the two 
wordings was used as a cue. The subject's task was to select fro^h the 
list of all case fillers that had occurred those that were appropriate 
for each of the cues (e.g. "Dompstic Welfare Agency" and "computer 
terminals"). 

This entire procedure was repeated for each set of stories • 

Results , ' 

The probabilities of correct responses on the .matching and 
multiple-choice tests are shown in Table A.l. Since errors on the 
tests could be produced either by memory failure for ^individual facts 
\or by failure to integrate related facts, test performance was 
considerably lower than 100 percent. 

. The results of the matching test are shown in the upper part of 
Table A.l. The entries give the probabilities of a correct match 
between case fillers associated with the same case frame for the four 
experimental conditions, Perfbrmance was better when in the one-story 
condirti-on than in the two-story condition, F(l,60) = 8.32, p < .01. 
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•^able 4.1 

PERFORMANCE ON THE MATCHING^ AND MULTIPLE-CHOICE TESTS 



Location of 
Related Facts 

One story 
Two stories 



Wording of Common Information in Related Facts 
Identical Paraphrase Identical Paraphrase 



Correct Matches (%) 



.A5 
.35 



,40 
"79 



Correct Choices of 
Pairs of Items (%) 



.57 
.44 



.S? 
.25 



'n addition, performance was better in the identical-wording 
condition than in the paraphrase condition, F (1,60) = 4.05, £ < .05. 
However, the latter difference was significant only in two- 
story condition (for the one-story condition, t(30) = .62: for the 
two-story condition, t(30) = 2.53, £ < .01). 

The results of the multiple-choice test are shown in the lower 
part of Table 4.1. These entries give the probabilities of correct 
identification of both case fillers associated with the case-frame cue 
for the four experimental conditions. These '^ta ar/? comparable to 
the results of the matching test. Performance was better in the 
one-story condition than in the two-story condition, F(l,60) = 
14.20, p^< .01; and it was better in the identical-wording condition 
than in the paraphrase condition, F(l,60) = 5.05, £ < .05. Again, 
this differenee was significant only in the one-story condition (for 
the one-story condition, t(30) = .62; for the two-story condition, 
1(30) = 2.7.8, p < .01). 

Multiiple-choice data f'-oin the paraphrase condition (see Table 
4.2) wer? analyzed further, in the multiple-choice task, haH" of the 
case fillers in the paraphrase condition had been presented originally 
with the case-frame cue given in the te.-t, and half had been presented 
with a paraphrase of this cue. Table 4.2 shows that, overall, 
individual case fillers were more likely to be identified if they had 



r 



b.een presented originally with the test cue (.69)' than if they had 
been presented originally with a paraphrase of the test cue (.52), 
F(l,30) = 24.66, £ < .001. This etfect was. great.e^^ in the twa- 
story condition than in the one-story condition, F(l,30il = 4.01, 
p < .05. 

Table 4.2 

PERCENT CORRECT CHOICES OF INDIVIDUAL ITEMS 

Wording of Cue 

J.ora*^ ion -if 

Related Facts Identical Paraphrase 

One ..tory .72 ' .66 

• Two^ stories .59 .45 



Discussion ' ' * 

These re.sults are consonant with the predictions discussed above. 
When related farts, such as (1) and (2), occur consecutively in a 
story, iutvgration of the two representations is highly probable. As 
predicted, the wording manipulation had only a small effect when 
related faults occurred together. Subjects performed well on both 
tcst^,. regardless of whether common information in related facts had 
identic.'' ..^ paraphrase wordings. This is consistent with our 
assumption that associative activation, as well as direct activation 
of the (1) .id.l (2) representation?, is facilitated by recent prior 
activation^ (1). Additional evidence that this integration occurred 
was obtained from the analysis of matching test performance within the 
paraphrase condition.- If the related facts were ' integrated^ subjects 
Jihould, have been able to identify case fillers originally presented 
with, the test cues and fillers originally presented wi th* pa raphrases 
of^he^cues. In fact, performance was quite good on b<lth kinds of 
case fillers /and the difference between them was small. 
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When related facts occur in two different stories, the (1) 
represer ^ is veaker during input of (2) than it ia when the facts 

occur Thus, inte£ration of the two facts is less likely 

than in ^. one^story condition^ This was reflected in the 
observation that subjects performed substantially worse in the 
two-story condition than in the orie-story condition on both the 
matching and multiple-choice tests. As predicted, the wording 
manipu^lation produced a large effect in tbi» condition. Subjects 
performed be^tter on both tests when common informaticu had identical 
wordings in the two facts than when it was paraphrased. This is 
consistent with our assfumption that associative activation is less 
likely to succeed than direct activation. Additional evidence o^this 
point derives from the analysis of matching test performance within 
the paraphrase condition. If related facts are nojb intend ted, 
subjects should be more likely to identify case fillers presjented 
originally with the test cues than fillers presented originally with 
paraphrases of- the cues. Performance was worse on both kinds of items 
than in Ihe saroe*story condition (where many pairs of related facts in 
the paraphrase^ condition were . presumably integrated). liore 
importantly » case fillers presented originally with the test cues were 
more likely to be identified correctly than fillers presented 
originally with paraphrases of the cues. 

The observed interaction between story and wording conditions is 
particularly noteworthy. Many researchers have supposed that botl 
lexical ar\d more abstract semantic codes exist in memory, but that the 
formeryi^ade rapidly, while the latter persist (Doobvpg, Christiaansen, 
& Keejian, 1975; Fillenbaum, 1966; Sachs, r^7A). ThiV. view predicts 
tKat the effect of the wording manipulation should decrease the 
temporal interval between presentation of related facts increases:. 
However, exactly the opposite result was obtained here. 

EXPERIMENT 6 

Some researchers have assurae;d that the integration of related 
fajts into a unified memory representation obscures memory of the 

S3 ^ 
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unique occurrences of the facts. For example, Bransford and Franks 
(1971.) observed that subjects could not discriminate OLD sentences 
from NEW sentences that were consistent with the information in the 
OLD sentence. They concluded: "Individual sentences lost thei. 
unique status in memory ij^-'favor of a more holistic representation of 
semantic memo ry'^^i^fT^ 348) . However, subsequent research (Katz, 
Ateson, & 1974; Katz & Gruenewald, 1974) suggested alternative 

interpretations of these data. In particular ,. the work of Bransford, 
Barclay, & Franks (1972) and James, Hillinger, & Murphy (1977) 
indicated that people retain knowledge of originally presented faces 
pven when those facts are integrated with others in memory. 

As discussed above, we agree with the latter assumption that 
integration of related facts does not completely ^scure their 
separate identities. WhetT related facts having paraphrased wordings 
are integrated, the preservation of wording information in memory 
distinguishes them, as shown in Fig, 4,3. Even when similarly worded 
facts are integrated by the sharing of common ^representations, 
however, sop.irate traces distinguish the facts, as shown in Fig. 4.2. 
The model can accommodate a small percentage of false recognitions of 
''integrated" facts (i.e., combinations of related fatris^t) by assuming 
that the lii s t wticti ve traces or tags encoding separately recorded facts 
mi)>ht occasionally deteriorate, while the reSt of the information 
persisted. FhusX^he theory predicts that there should J^e fewer false 
recognitions, of '*i ntegrated** facts than correct recognitions of facts 
that wefe actually presented. This di scriminabi lity should hold 
regardless of whether the common information in the related facts has 
identical or paraphrase wordings. 

Kxperiment 6 tested this., hypothesis for the materials and 
conditions of Experiment 5. Subjects were given a combined 
recognition-verification test containing OLD items, which had actually 
been' presented; INFERENCES, which integrated the information in ^ two 
separately presented but^ related facts; and NEW items, which contained 
concepts and relations from presented facts but combined them 
inappropriately. For each test sentence, subject* judged wnether the 
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Hentence was OLD (had been presented originally) or NEW (had not been 
presented originally)* For items judged to be NEW^ subjects indicated 
whether the sentence was TRUE (stated information that was true in the 
passage although not expressed in a single ^sentence) or FALSE* 

We assume that either an OLD or a NEW-TRUE response to a test 
item implies that the subject has learned the information in the item. 
Thus, an OLD "or NEW-TRUE response to an OLD item implies that the 
subject has learned the item. An OLD or TRUE response to an INFERENCE 
implies that the subject has integrated the facts necessary to derive 
the INFERENCE. 

We assume that an OLD response to a test, item implies that in 
addition to having learned the information in th'^e item, the subject 
perceived an effectively perfect match between the test item and its 
memory representation. Thus, an OLD response to an OLD item implies 
that its memory representation hac remained relatively intact. An OLD 
response to an INFERENCE implies that any trace encoding the 
individual identities of the constituent facts has deteriorated, while 
the memory representation of the remainder *of the information has 
persisted* 

The prediction can restated in terms of OLD versus TRUE 
response probabilities for OuD items and INFERENCES. If constituent 
facts retain representational integrity even when integrated, subjects 
should beable to discriminate presented facts from INFERENCES in -all 
conditions. That is, relatively few OLD responses should occur for 

INFERENCES, and the probability ot ^n OLD response should be 

substantially lower for ' INFEREK'JilS . than for OLD test items. 
Integrated knowledge of related facts should, instead, be exhibited as 
high rates of NEW-TRUE reponses to INFERENCES. If, on the other hand, 
constituent facts lose their identities in integrated memory 
rep i^esentat ions , ?ubjefcts should produce many OLD responses to 
INFERENCES on a recognition test. When integration is very likely to 
occur (in the one-story, samc'-wording condition, in particular), such 
false-alarm rates for INFERENCES should approach hit rates for OLD 
items. Relatively few NEW-TRUE responses should occur for either item 
type. 
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Method 

Materials. The naterials were the same sets of stories used in 
Experiment 5, with the modification that new filler sentences were 
constructed that specified two filled cases in the sentence c»se 
frame, rather than one filled case, as in the* constituent facts of 
related pairs. These filler sentences occupied their- same serial 
positions in the passages as in Experiment 5, so that each passage 
^contained some sentences with one case specified and some, sentences 
witn two cases specif i^ed. 

Three types of items were constructed for the 
recognition-verification test. The OLD items for each >«<*V)f thre^ 
stories comprised the six filler sentences frort .the three stories. 
Six INFERENCES were constructed by combining each of the six pairs of 
separately presentee] but' related facts into single sentences, -^or 
example, one such item constructed from the materials used in 
Experiment 5 was "The Domestic WeAfare. Agency distributes information 
about professional options using computer terminals." These sentences 
could be correctly classified a^( NEW and TRUE. Six false NEW 
sentences were constructed by «,4iiapyrupi'lab«J^ ii^tegrating the 
information from two separately presented sentences. Thus all test 
ittms specified filler, information for two slots in\a case frame. 
There were 54 test items in all, 18 for each set of stories. 

Subj ects. Sixty-four UCLA undergraduates participated in the 
experiment, either for payment of $2.50 or ^ to fulfill a course 
requirement. ' •• . ' . 

Design and Procedure. The four experimental conditions were 
identical to those in Experiment 5 (identical versus paraphrase 
wordings of related facts crossed with one or two stories). Subjects 
.were randomly assigned to one of the four conditions. In each 
condition, there were three types of. test items: OLDs, NEWs, and 
INFEMlNCEs . V 

clach subject worked iijdividually with a booklet containing the 
stories. Subjects studied each set of three stories, using the 
study-recall-check procedure described for Experiment 5. Then "^they 



ERIC 



82 

were given a combined recognition-verification teat. The 18 test 
items were presented in random order. Subjects indicated whether each 
test item was OLD (had occurred exactly as stated in the studied 
stories) or NEW. If an item was judged tS be NEW, the subject also 
indicated whether i-t was TRUE or FALSE. A TRUE response meant the 
subject believed the fact gave true information from the stories, even 
though the sentence had not been presented explicitly. 

* . 

Results . ^ 

For each subject ill each condition^ the probability of responding 
OLD aiid-'the probability ^pf responding OLD or NEW-TRUE were tabulated 
tor OLD and INFERENCE test items. (The latter probability was simply 
the sum of the probability of responding OLD and that of responding 
NEW-TRUE.) Each of these probabilities was corrected for guessing, ^ 
•using a variation of the hig^h-threshold correction. The following 
corrections were used". 

Corrected P(OLD|OLD) = 

{P(OLDIOLD) - P(OLD|NEW)}/{r- PCOLD|NEW)} 



Corrected P(OLD| INFERENCE) = 

{P(OLD I INFERENCE) - P(OLD|NEW) }/ { 1 - P(OLD!NEW)} 




Corrected P(OLD or TRUE|OLD) = 

{P(OLD or TRUE I OLD) - P(OLD or TRUE! NEW)}/ 
{1 - P(OLD or TRUE I NEW)} 

4 

Cocrected P(OLD or TRUE I INFERENCE) = 

{P(OLD or TRUE [INFERENCE) - P(OLD Or TRUE | NEW)}/ 
{1 - P(OLD or TRUEINEW)} 

The data for OLD responses and NEW-TRUE responses were analyzed 
separately. In each case, the data were submitted to an analysis of 
variance that 'treated wordings, number of stories, and items (OLD or 
INFERENCE) as main effects. 

0-5 
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The results are given in Table 4.3. The. top half, of the table 
presents the proportions of OLD responses given to OlD and INFERENCE- 
test items in each of the four; conditions (identical versus paraphrase 
wording crossed with one versus two stories).' In all four conditions, 
subjects made fewer OLD responses to INFERENCES than* to OLD items. 
The main effect of items was significant, F(l,36) = 85.61, _p < 
.001. tTic probability of an OLD response was greater in the one-Sto.ry 
(.57) than in the two-story condition (.42). This main effect of 
number of stories was also significant, F(l,36) = 19.21, p <^001. 

The bottom half of Table 4.3 presents the proporti^)ns of OLD or 
NEW-TRUE responses givep to OLD items and INFERENCEiS in each 
condition* Subjects made more OLD or NEW-TRUE responses to both OLD 
items and INFERENCES in the one-story condition than in the two-s^tory 
condition. There was a main effect of number of stories, F(l,36)- = 
10.9^, P < :01, but no main effect of item type (OLD versus INFERENCE 
F(l| 36) = 0-584. However, there was a signifitrant item- 
typt - by - wording (identical versus paraphrase) interaction, 
F(l,36) = 5.66, p < .05^' That is, while there was no difference 
between OLD or NEW-TRUE response probabilities to OLD versus INFERENCE 
items in the identical wording condition^ these probabilities /Cere 
higher for OLD items than for INFERENCES in the paraphrase wording 
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Table 4.3 

RESPONSE PROBABILITIES ON RECOGNITION TEST 



Same Story 



Different Stories 





Wording 


of Common Information in 


Related Facts 


Item Type 


Same 


Paraphrase 


Same 


Paraphrase 


P(OLDr 










OLD 


.77 


.84 


.58 


.•60 ' 


INFERENCE 


.28 


.38 


.28 


. .22 


P(OLD or TRUE) 










OLD 


.87 


.86 


.64 


.72 


INFERENCE 


.89 


.79 


.73 


.58 
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Discussion 

. ^ . ^ 

The absence of any main effect of item type on probability of ah 

OLD or NEW-TRUE response indicates that, in' general, subjects 

successfully integrated related facts as often as they learned OLD 

items. Thus, if integration obscures the identities of constituent 

facts ^ subjects should have responded OLD to INFERENCB^as often as to 

OLD test items. However, as predicted, substantially higher 

probabilities of OLD responses were observed for OLD items than for 

INFERENCES . Subjects apparently retain information about the 

individual identities of the facts they, study even when those facts 
are integrated in memory. < 

It might be argued that in some conditions (for example, the 

.paraphrase wording condition), subj^ects *did not integrate related 

facts as often as the^ learned OLD items. * This would also produce the 

observed effect. However, in the oije-story, identical-'Wording 

condition there was clearly no difference in the probability of 

integrating related facts and the probability of learaing OLD items 

(i.e., no difference between probabilities of OLD or NE^TRUE 

responsj^ to OLD items and INFERENCES). Yet it was in this condition 

that the largest difference between probabilities of OLD responses to 

OLD Items versus INFERENCES was observed. 

^ The ri^ults of Experiment 6 provide additional support for some 

of the iifredictions supported in Experiment 5. The OLD or NEW-^TRUE 

responses to INFERENCES indicated that subjects were more likely to 

integrate related facts that occurred in one sto^y than those that 

occurred in two different stories. They also indicated that subjects 

were / more likely to integrate related facts if the common information 

in those faces had identical wo'rding than if it was paraphrased. 

EXPERIMENT 7 

Experiments 5 and 6 investigated integration of facts that were 
constituents of higher-order knowledge units. The inferential process 
enabled by integration was essentially concatenation of two knowledge 
structures. 
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People also integrate facts haying other kinds of relationships 
to enable more sophist ixra ted inferential processes* Consider, for 
example, the fol lag two facts: \ 

' (4) Albert Profiro hated all dictators. 

(5) * King Egbert was a dictator. 

Integration of these twoc fadts would provide a valid basis for 
inferring: . • ^ 

(6) Albert Profiro^ated King Egbert. 

This experiment investigated integration of facts such as (4) and 
(5) above and the influence of integr^ion on subjects' performance of 
deductive reasoning ^sing the facts as premises. Subjects stiKiied 
several pairs of stoj^es containing pairs of related facts. Each «pair 
of I'elated facts iould be used to support an inference* After 
studying each pair ok stories, subjects verified a set of true and 
false inferences. / ^ 'A- 

Consider what ^he subject might be doing in order to Verify an 

/ 

inference such as (/6) above* Correct verification of a true inference 
requires simultaneous consideration of two studied facts (for example, 
facts (4) and ($))* Presumably, subjects would attempt to use the 
information in a ti2st item to cue retrieval of facts from memory to 
support it. For) example, the subject could use the information 
''Albert vProf iro hated'' to cue retrieval of (4) and use the information 
''King Egbert" to cUe retrieval of (5). Given successful retrieval of 
(4) and (5),.. the subjept must reason across the two premises to 
validate (6). (fi^ the case of a false test item, the subject will 
presumably fail j to retrieve any pair of facts that can function as 
premises in the validation of the test item and will thus respond 
FALSE.) 

Figures 4.4 and 4.5 illustrate non- integrated and integrated 
representations lOf (4) and (5).' Again, the details of individual fact 
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repreaentations are arbi trary. and should be tlisregarded. The 
'important aspects of Mgs.. 4.4 and 4.5 are the struc.tural 
relationships between the two fact representations* . The, 
non- Integrated represetitajji^ in Eig. 4.4 -have no shar.ed structural 
components. The, integrated repr#*&entat;Lons ip Fig. 4.5 share a common 
subrepreseatatiion of ''dictator . . *^ . 

It the /facts necessary to * validate a test ^xte)q have 
non- integrated memory representations, the- subject must retrieve, each 
,of th^ facts independently. That is, the subject offlfust use • the 
information ''Albert hates sdmeorie" to, retrieve (4) and then,. 

independently, use the information *'King Egbert" to reprieve -^CS) • Lf, 

t. . . 

pn • the other hand, • Ue . two facts .have integrated memory 

* I • 

representations, activation of^either one of them entails , activating 
the other: That is, th^ subject can Use t^fie, i!nf ormation ''^bert "hates 
someone-'' to retrieve (4> and (5-). Alternatively, the subject can use 
the information* *'Kang Egbert to retrieve (4) and (5). Tl^us , 
integrated memory representations 6f plated facts such as (4) and (5) 
can. facilitate inferencing based, onl^ those fActs in two wajs: firsts 
le&s processing i§ required to activate one integrated representation 
than to activate two independent •representations. jSecond, two 
independent cues are available • to activate the ^ integrated 

representation, compared tos^tjde single ' pair of cues available to 

>^ • - ■ 

activate the two independent repr^^pfttations . y * . 

Two independent variable^ were manipulated in this experiment. 
Common information in the pairs of stories^ subjects studied, and 
particularly in the pairs of facts necessary to verify test 
interences, had eilhe-r identica^l . or paraphrase wordings. Pairs, of 
tacts in the identical-wording condition are illustrated by (4) and 
(5) above. Pair^of facts in the paraphrase cbnditi<).i are illustrated 
by (4) and (5'): * ^ 

) King Egbt^rt was an autocrat. ^ ---^ 



According to Che assumptions o(it lined above, integration of the two 
facts can' occur in either condition. (Integration of (4) and (5') 



would require encoding of the equivalence relatj-on between "dictator" 

and "autorrat," as illustrated" in Fig. 4.3 for ttte equivalence 

relation between , "provides career counseling" . and . "distributes 

information about professional optiojis/") . However^ identical' wordings 

of the common 'information should facilitate* integration. ^Therefore, 

subjects should per^orni better on the inference .tecit in the 

identical -wording condition than in the paraphrase condition. 

* • • 

The second indepiendtent variable w^'as 'retention interval. Subjects 
'performed the inference test after either 0 or 30 minutes. ^ If the 
wording manipulation produces the a&simed effect on mtsmory 
representations, relative performance in the identical-wording versus 
paraphrase conditiori.s should be * comparable fot both * retention 

intervals. ^ . • ^ 

I . 

Method I 

^ ■■ 

Materi als > Four p^irs of meaningful ^tories. were constructed. 
All of the stories were about the, mythical country Morintl^iia. Each 
inaividu^l story was *about a different topic, but the stories within a . 
pair were about* related topics. The .four pairs* of topics were (1) Thfe 
First Mo^inlhian Revolution, and^The Imprisonment of Albert Profiro; 
(20 Religious Customs and , Beliefs in Morinthi^a, and (Religious 
Overtones During) the Fever Epidemic; (3) The Marriage of Princess 
Isadora, Successor to the Throne of Morinthia, and The Romance 6e>meen 
Priificess Mathilde and Basil; and-^. (4) T!he Provincial Lifestyle •in 
Morinthia, and The Home of the Caledian Ambassador. 

Each pair#of stories inclyded^^ur pairs of r^lated facts, such 
as "^(4) and (5) or (5*) above, jtdfh pair of related facts contained 
tRVs^ information necessary to support a. particular inference not 
explicitly stated in either story^ (such as (6) above)** Related 
Stories and, in particular, the related facts within the stories had' 
either, the identical or paraphrase -wordings of common, information, as^ 
i 1 lust rate4above by the alternative pairings of (4) w^th .(5)^^r (5 ' ) . 
*As an illustration of these materials, one- set of stories exemplifying 
ihe i^ntic«/l -wordings condition* is presented below. 



The First Morinthian RevJlution^ , 

* The . Spring Epist>de was the first revolution ^ irt* 
Morrnthia, The outbreak occurred shortly before dawn on 
April 17^, tSAJ, The revolution was undoubtedly caused by 
the . tyranny imp^osed upon the Morinthian people by King. 
Egbert, the ^dictator • For 'months^ ' Egbert . tjad extracted 
half of alV the eirnin^s of the people. However, the 
ipnediate cause of the outbreak appeared to be a minor 
crime coimnitted several days earlier^ A peasant hdd 
poached several ^chickens from the royal henhouse to serve at 
his ^daughter's wedding. It seemed a minor offense to the 
people, but , in Morintbia, everyone who disobeyed .the law 
was punishedv.severely , The 'peasant was branded pne of the 
king's Enemies and thrown .into prison. ^ The Morinthian 
prisoh wa.s populated exclusively by the king's enemies. The 
towrNjpeople we r.e' thrown into a frenzy at the severity of the 
sentence/ Even those who swore . lojaity to Egbert joined 
the crowds demanding freedom for the peasant. The 
ctowds ^tormed^ the palace. An effigy of the king was 
burned.*^ Egbert commarrded them to respect his authority 
and^disperse at. once, \In the end, Egbert called out his 
guards and martia-K/law was imposed, So ended .the first 
Morinthian rrvoliiLion, all* of wl)ich were doojjitd'to failure. 

The Imprisonment of Albert Profirot 

The Curfew Episode was the second, revolution in 
Morinthia., It provided , Ihe se^ttiag for several important 
events in the life of Albei^t Profiro, a yqung / Morinthian 
tradesman. ^ The outbreak Recurred on March 22, 1844, the 
day after ''a group, of youths were discovered to have 
diiSob^y^d ^ the curfew ' law. The law had been a source of 
friction between the townspeople and *. th^ government for 
some »time. The people welcomed the opportunity to flood' 
the streets, throwing' stones and damaging property, 
-Albert took it upon himself to try to calm the people. 
Although Albert hated all.', dictatjors and their 
governments ^fi^^ hated anarchy in the streets even more*. 
So he positioned himself on a platform in the center of 
the town square and called upon* the people to return to 
their homes. Unfortunately, when the royal soldiers 
arrived*, *. tl|py v^nly saW a young man shouting to the crowd 
and assumed he was responsible for the •riot. Albert was 
arrested and -throw^ into prison • Although Albert spent.' 
three bitter years in prison, his experierfce brought seme 
good Vith it as well. It was in prison that Albert met 
Anastacia DeVille, whom he subsequently '«<t£;^ed . 



^ Subj ect s. Twen{.y*slx41CLA undergradudtesw participated in the 

"» . • \ ■ • ' ■ ♦ , ' ' » 

two-.hour exfferiment. ^ubject^ were, either paid $2.50 or given, cbar%e 

credit tor their participatj,oii". « ,. - ' .* .f 

Design." A 2 X 2* factorial design was used. The wording of 'the* 

conunon information in the two/stori^s ^identical or paraphrase)* was 

' ciosse^ with ruten^tion interval (0 or 30i minutes) to produce four^ 

\ondibxons. The "wor^ing^ manipulation was 'a w{tKin*a:ubject factor. 

The retention-interval manipulation was betweeii^subjects factor, 

with U . subjects in the 0-m:'-v;te retention-interval condition and 15 

sub jec ts in the '30-minute rje^entioa-interval condition. 

Procedur^^ Subjects were tested in groups 7 Each subject was 
^ * * *" * • ' , 

given a booklet containing the experimental storiesi and tests. 
A - ^ ' % ^ ^ 

Subjects *\ progress through the booklets was self-paced. ' Intentional 
learning instructions were given, inclfc^ding the warding that an 
inference test would be givenr ^ % ^ ' ' . 

Subjects istudied and were tested on each of the three stories as 
follows. The^ read, a pair of related stories carefully, attempting to 
learn as much as possible. Then they were given a verification test. 
On this test» TRUE items were defined as those that could be proved 
tru'e, given Che information ift the stories. FALSE items were defined 
as those that coyld not be proved true, given the information in the 
stories. T»here were tour TRUE »and four FALSE items, ordered randomly, 
on the test following each pair of stories. This study-test procedure 
was repeated for each of the four pairs of topically related stories. 

After subjjects hkd studied and been tested on all stories^ they 
were* given a f\nal test of the inferences in syllpgrsm form. ft On this 
tt^st, each, inference was immediately preceded by the *two facts that 
presumably determined its validity. Subjects siiflfpiy indicated whether 
<\r not Vach inference followed logicalTv "from the two facts that 
preceded it. ^ 

Resjults and piscussjon ^ 
The, analysis of performance on the verification task included 
only those items to ys^hich the^ subject had responded ^'correctly'' on the 
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.fioal syllogism test. ThAt is, inferences for whi,ch a w abject could 

not perform the necessary ^reasonin^ cdtrectly, given the premises, or 

for which the subject disagreed with the experimenters* reasoning were 

'excluded from the -jiaalysis. Thus^.the data reflect only the subject \s 

ability to retrieve the faits necessary to verify a particular 

i.nference% not his or her ability to perform the^ lieces^ary reasonsing 

on thqse facts. \ / ' 

. Table 4.4 shows the corrected percent correct responses in jeach 

of; the four experimental conditions (identical versus paraphrase 

wordings crossed with 0- versus 30*miriute retention interval). At 

. « 

both retention intervals, subjects verified inferences more accuratiely 
in the s^dentical-wprding condition than in the paraphrase condition, 
F(l, 24) = 5-72, g <-.025. These results ^ppor> the predictions 
outlined above. ' Presumably^ identical.^ wordings increased the 
probability that the two facts underlying an inference would be 
integrated in nicnory. rntegrati^,\in turn, enabled rither of the two' 
cue*^ irtiplicit in the .inference (e.g., "Albert Profiro hated someone*' 
and "King Egbert" in the infetence "Albert Profiro hated King Egbert'') 
t9 cue retrieval of both facts. Jl^en the facts underlying gn 
inference were:, unint^grated, each of the facts had; to be retrieved 
independently, given a single cue. Retrieval of. a pair of 
unintegrated facts required more processing and was less iikely to 
succeed than retrieval of an integrated representation of a pair of 
facts. Thusj integration of related facts facilitated performance on 

Vv 

the inference test by facilitating retrieval o*f the facts necessary to 
verify inferences. * ' 

Table 4.4 

CORRECT INF£RENCE VERIFICATIONS 
...(percent) 
* ■ » 

Wording of^S^tHmon Information in Related Facts 

Retention 

Interval Identical Paraphrase 

0 minutes*" .78 ' ' .57 

3u minutes .7^ * ^ .65 
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.GENERAL- DISCUSSION 



The- pre^&eut. r^^search compLetijents. previous. re«5acch on ^ knowledge 
integration in two ways; .First, it replicates the basic integration 
phenomenon under previous,ly untested conditions. Subjects encountered 
related facts in fhe context of ^lat*iVely long, meaningful texts. In 
addition, related facts occurred either in a single text or in two 
separate , texts.. The results reported indi«?ate that integration can 
occur inXboth, cases-. Second, the research identified factors 
intluencihg whether or not subjects, successfully integrate a given 
pair of related facts.- The. results indicated th^t temporal proximity 
and similarity., of wording facilitate integration.. These effects 
follow, directly from th? ffew simpf|j|[a.ssumptions regarding basic' memory 
structures *and processes outlined above. 

« 

It IS appropriate, at. this^ paint, to introduce plausibfe 
alternative accounts of integration. Like, previous researcliers , . we 
have assumed t|Mt 'integration is a structural phenomenon that occurs- 
during storage of related facts . ' Let us consider the' alternative view 
that individually presented facts alway« generate independent. memory 
representations and that integration is a retrieval phenomenon. In 
Other words, assume that^fiiobLects exhibit knowledge of higher-order 
ideas or ^inferences by retrieving and -appropriately, combining the 
necessary indep^endently stored constituents at test time, ' 

•w jiadopting some 'of tiie same assumptions as in the structural 
model/ the retrieval model can account for mist of the results 
reported- Assume again that^memory representations preserve lexical 
informaticfTf* and i that direct activation is Imore reliable thin 
associative activation. The retrieval, hypothesis simpl> assumes that 
simultaneous activation 6f- related facts must occur it test time, 
rather than at storage time. - The dynamics gf this simultaneous 
activation remain the same. The retrieval Tiodel accounts fo* the 
observed effects* of the wordings* matiipulation by assuming that 
identical wordings of yelat^ facts permit them to cue ono^another 
directly. Paraphrase^ wotdings require ^opiative diQt\(^x\oii via 
^'semantic mediators. Therefor^, integr^ation is 'more likety to succeed 
in the fortner case than in the latter. / — ^ 
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: The retrieval modfel accounts for the. effect of presenting ^related 
facts consecutively in one^s^ory by assuming that f»fcts presented in 
close teltporal proximity have proximate memory locations. Retrieval 
of a related pair of facts can be accomjplished qither* by retrieving 
the two facts directly or by retrieving one and searching for the 
second. If . the segond fact-is' stored ' near the first,, it is mor« 
likely to be retrieved than if it is stored further away. Therefore, 
integration is more likely to succeed if related facts" have occurred 
consecutively than if they have occurred in two differenj: stories. 

The retrieval model c^n also account for 'the interaction between 
wording ^ temporal proximity of related facts. It incorporates a 
simple variant ^of the structural models assumption: Proximate memory 
locations, tor related facts facilitate, associative as well as '^rect 
activation. ' ' * , 

The only result that challenges the retrieval model occurred In 
Experiment Subjecj^s responded "OLD" ,to substantial numbers oTIjEW 

test items t ha t *i Qtegrate OLD test" items. 'VThe model has no ^t^vioUs 
mech~%nism tor 'handling .this iresult. Because the result has been 
replicated rtiauy times, by many different investigators, it is a . 
ser^ious problem for; the retrieval model. * . 

We must . consider -» a second, alternative explanation for the 
results of Experiment 7. Subjects might actually draw and store the 
inf^-rences themselves while studying the sou/ce texts. These, rather 
than inlegtaLcd representations of the underlying facts, might be the 
basis lot- '-oitf'cL inference verification on the subsequent test. • 
Again, by adopting assumptions similar to those of the structural 
model, the literal inference model can account for th^ wording effects 
observed iri Experiment 7. However, it can be criticized on "common ' 
sense" grounds. Because subjects did not know in advance whicl^ 
infarences would be tested, they would have to have stored all of the 
many possible inferences' based on facts in the two stories. It is,* 
unlikely that subjects could have done so or that people generally 
draw and store all * possible inf^erences from the information they » 
acquire. 
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While both of the alternative models described above *have 
p^r.oblenis, they can account for many of the * results reported.' Of 
course, we cannot attribute the same significance to these post hoc 
explanations that we attribute to whe structural model's prediction of 
the results. By the same token, however, wf cannot rule them out- Lt 
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would be too extreme to conclude from these obselwations that 
integration xs invariably a ^triptly structural phenomaAon. It seems 
obvious '^hat pegple sonetimes draw two distinct memories together 
^specifically to evaluate a hypothetical inference. It also seems 
obvious that people sometirHtlf^ generate and ptore inferences from 
source material tb^y ^^^^w While structural integration probably 
underlies many of the, observed integration pheilorrfena, i^ is likely 
that both of '•the alternative processes desprdbed abeve ^h\so occur 
occasionally. Additional research is needed * to elucidate the 
condit ions xxnder , which each integration process occurs. 

Regardless of which model one adopts, the present results imply 
certain t^heoretical <^onstraints . In these experiments , bp th wordings 
and temporal proximity "of related -'^ tacts influenced, jwiiether or not 
subjects 'integrated the fact?. Any viable model of integration jnust 
include assumptions to account for these effects. ' * 



V.' CONFIGURAL EFFgXTS- IN HllMAN MEMORY 



Chapter. IV investigated two factors influencing the integration 
of related facts^ into a single, coherent structure. Frequently, such 
fact,s can serve as prenvises from which logical- inferences can be made. 
For example, consider the . following. two facts: 



* . • 

(1) Albert Profiro hated all dictators. 

(2) . King Egbert was a dictator. ' ' . • 
These, two' facts can be configured logically as . ^ 

' * 

(1-2) Albert Prof iro; halted all dictators, one of whom was King 
Egbejr.t . ;s . ^ 

to provide a basis for the. inf^rdnce: • , 

Albert Profiro hated King Egbert. > ' 

• ♦ 

♦ . * 

\ Given (3) as ^ hypotheti il inference, , an' effective reasoner 
shoul.d be able to reason backward to verify (3) on the basis of (1) 
and (2). *To do this, the reasoner would have to identify (1) and (2) 
as" being relevant to (3), configilre them appropriately, and perform 
the deductions \ 

This chapter shows that identifying/and c6nfiguring facts in- 
order to support hypothesized inferences is extremely difficult unless 
the facts have been committed, to memory. Simply readj.ng relevant 
ttjxts for familiarization and then referring to them as needejj 
provides^ an inadequate basi»s for deductive logic. Further, 
apprehension of the logical configuration, of premisses underlying a 
particular, infe^ence can be an essentially automatic process for the 
reasoner who has structured the If acts appropr'iately in memory. 



Jhe research reported in this chapter began with an unexpected 

result « obtained fronv^an unpublished experiment conflicted in our 

laburaLory. Subjects ^ere given' texts containing pairs o£ facts such 

as (I) and (2). The7*^pre thejn asked to verify inferences such'as 

(3). Distxactors, whose truth values were indeterminate, were also 

included .^n^ the inference test . In a TEXT condition, subjects simply 

glanced over the texts in order to become familiar with the subject 

matter. Duriixg the inference test, these subjects were permitted to 

refef back to the tejas . In MEMORY condition, subjects were 

instructed to study the texts carefully, attempting to learn as much 
f 

ol the information they contained as possible. ,During the inference 

test, these subjects were not permitted to*.refer back to the texts.. 

The most intuitively obvious prediction for\the outcome of this 

experim^t is that subjects should have performed better in the TEXT 

condition than in the MEMORY condition. The texts were short enough 

(approximately 200 words), to be read in a few minutes. It would ^eem 

that given freedom to refer back to the texts, during the -inference 

•test, .subjects in the TEXT condition should have been able to find the 

facts necassary for inference verif icatiion and therefore should have 

performed very well. The texts were too long to have been committed 

perfectly to memory, so ►subjects in the MEMORY condition must have 
« 

forgotten many of the facts necessary to verify 'inferences before the 
inference test was given* Thus, they could not be expected to have 
performed as well as subjects in the, TEXT condition. 

The results of the experiment were straightforward: Subjects 
performed comparably well in both conditions. Subje/ts in the TEXT 
conditio^ responded correctly to 81 percent, of the true inferences, 
compared to 85 percent for subjects in the MEMORY conditioja. Subjeicts 
in the TEXT condition responded correctly to 79 percent of the false 
inferences, compared to 85 percent for subjects * in the MEMORY 
condition. Neither difference is significant, and both differences 
actually favor performance in the MEMORY condition. 

^ We believe that the explanation for this finding can be 
summarized in two assertions: (1) People do not know how to search an 
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external • information so-urce, such a text, for cftnfigural 

.information., That is, they do not know how to , search Votv , logij^al 
. configurations of facts that support hypothesize^ inferences. (*2) 
Automatic memory mechanismi frequently organize acquired' irforipation 
so that ^onfigural information is directly accessible. That is, 
related facts are frequently stored together in memory in *a meaningful" 
configuration are directly accessible as an integrated data 

structure. In Phe next section, we elaborate this view of the search" 
and memory mechanisms underlying inference verif ication.^ 

MOD E^^IMG INTEGRATIVE INFERENTIAL REASONING , . *^ 

To verify an inference in the ^present experiments, a subject must 
_ perform a" "backward" reasoning task. That is, he must search .the 
"texts or memory for two critical facts which,, simultaneously 
c^^nsidered and apbropriattly configured, permit logically valid 
deiduction of the test,^ inference, 
abdive : 



Consider the example introduced 



< ^ 



\, (3). Adbert^Pr^ofiro hated King Egbert. 

■'l • . ■/ ' 

Any number of pair^ of possible facts might justify (3), including, 
for example, the following:. 

(1) Albert Profiro hated all dictators. 

(2) King Egbert Was a dictator* 

(4) Albert Profiro was a radical. 

(5) All radicals hated King Egbert. 

(6) Albert Profiro knew about King Egbert. 

(7) Everyone who knew about King Egbert hated him. 

I « 

We refer to the pair of facts that justify an inference as "critical 
facts." Thus, tha subject begins the search for critical facts without 
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•knowing exactly what those facts might be. The only guidance the 
subject has is that each fact must refer to at least one of the 
concepts or actions itivoived in the inference. (Note that this is not 
always a simple matter of " keyword fef erencing. The conceptual 
relationships between critical facts and the associated inference may 
be masked^ by synonym substitution, extensive paraphrasing, or 
special! xaticn-generalization relations. These cpmplications did not 
occui in the present experiments.) Further, since the texts in this 
experiment are cohesive stories, the concepts and actions in the 
inference occur in many different facts. Thus, it is necessary for 
the subject to search a relatively large set of facts, including many 
''candidate'* critical facts (those referring to critical concepts or 
actiohs)^ tor an unknown pair of facts that could be configured in 
some way to justify the inference logically. 

Ideal^ersus Actual Search Mechanisms 

Let us consider performance of the backward inference task in the 
TEXT condition. While the task is a difficult one, the way that a 
simp le^mihded , computer program could petform it is obvious. First, 
the program would examine the text3 sys teTnatj.€^riy for facts referring 
to the critical concepts or action><'- The set of candidafte facts 
ident^ifitni must^ contain pair of critical facts which, when 

appropriately copf ijjafed, constitute a valid proof . Next,Nthe prograhi 
would for*nuJ.afe every possible pair of candidate facts, attempting to 
configure each pair so as to justify the inference. In the course of 
this activity., it would either encounter a' pair of critical facts that 
logically j ust i f ied* the test inference and respond ^^TRUE," or it would 
exhaust the set of pairs and respond "FALSE/* * ^. 

The computer program described above ill^i^strates the kind of 
search people "ought" to perform. Potentially relevant candidate 
tacts might have occurred anywhere in the source texts. "Only a 
systematic and exhaustive search of the source information^ regardless 
of whether that information resided in memory or in an external text, 
would guarantee detection of all candidate facts. Similarly, any two 



candidate fcacts, , when properly configured, might support the test 
inference. jOnly cystematic formulation of all possible' pairs of 
candidate f'acts would guarantee detection of th^ pair of critical 
fatrts underlpng a true test inference. Systematic formulation of all 
p*irs of candidate facts is also ne'cessary because of ' the 
characteristics of humUT^IllTOTy . . * Efforts to viogically coufigupe 

^candidate facts presumably occur in "wording memory." Given the severe 
limitations on human working memory capacity (cf. Miller, 1956), only 
a systematic pairwise consideration- of candidate, facts would guarantee 
simultaneous resid^jice of the two critical facts in .working memory . 
While a variety of algorithms exist that cduld accomplish a systematic 
search, It is obvious 't,hat our subjects did not use any of them* If 

'they had, ^hpy^ like Utfe /hypothetical computer program, would have 

performed perfectly on the inference test in the TEXT Condition.' 

♦ * . , .. . ' • 

V • - 

, yp 9J: ^?L^ ISA 1 M^lwSry Me^chapisms 

Now let us consider perforihaitteeL of the backward inference task in 
the MEMORY condit ion. Return to the examp1>^d is cussed above . Ih 
order to verify this^nf erence 

(3) Albert Profiro hated King Egbert. 

the subject must retrieve two critical facts from memory: 

* • *• 

(1) Albert Profiro hated all dictators. 

(2) King Egbert was a dictator. 

As we have roted,^ the only cues available to the subject are the 
concepts and actions involved in the inference. Thus, the so )ject 
eventually must cue retrieval of the fi^st fact with the information 
''Alb' rt Profiro hated . . . and cue retrieval of the second fact with 
the concept "King Egbert.'' In addition, the subject presumably must 
retrieve the two facts in close ^temporal proximity so that they can 
reside simultaneously in working memory. How can this happen? 
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We assume that, .once learned, pairs of critical facts are likely 

^o have been stored in . integrated memory representations, as 

illustrated in Fig. 5.1s Each of the critical facts is repifesented as 

a configuration of nodes representing concepts, properties, actions, 

etc . The relations among the concepts ^ properties , and actiohs 

expressed in the fact are 'represented as associative connections among 

the nodes. The representation in Fig. 5.1 is integrated because the 

two fact representations share a * common subrepresentation ,the 

comflMnon concept, "dictator." (See Hayes-Roth and Thorndyke (1977) for 

discussion of some of the factors determining whether, related facts 

f ^ 

are stored in integrated or independent: memory representations.) 

Given an integrated memory »epresentatipn of the two criticaL 
facts, the following search processes are postulated. Each of the 
concepts and actions in the test inference automatically retrieves 
memory representations of all facts e^at refer to it. Because the two 
critical, facts are integrated in memory, retrieving either one of tiiem 
entails'^ associatiyely retrieving the other. Thus, the integrated 
memory representation can be retrieved by either of the two 
independent cues available in the- inference. (Hayes-Roth and 
Thorndyke (1977) proposed thd^s view of the structures and processes 
underlying, knowledge integration. Anderson and Bower (1973), 
Hayes-Rot^h (1977) , .HayesrRoth and Hayes-Roth (1975), Potts (1977), and 
Rxunelhart, Lindsay, and Norman (1972), among others, have advanced 
similar views. ) * ' • 




1 

Fig. 5.1 — Integrated representations of facts (1) and (2) 



Becaase two independent cues "collaborate" to retrieve' the 
integrated memory representation, its retrieval is nibre likely and 
more i-^pid tha^ . retrieval of ajci/^ other cued facts. That is, the 
integrated representation of th^ critical facts is retrieved and 
available for subsequent processing before any non-critical candidate 
facts are retrieved. Thus, other candidate facts are unlikely to 
distract the subject from th^^ critical facts or to interfere with 
their simultaneous residence in xv'orking memory. 

Once retrieved, the integrated representation provides a ready 
basis on which to perform the nece^ssary inferential logic.. As 
illustrated in Fig. 5.1, the hypothetical inference (3') is implicit in 
the structure of the integrated memory representation of the two 
critical facts. Thus, searching for relevant facts and teasoning 
across separately acquired facts to verify a test inference reduce to 
essentially a recognition . process. Information in a true test 
inference automatically cues retrieval of an integrated memory 
representation of the two critical facts in which the . inference itself 
is implicit and Apparent. ' ' - 

In order tu teat these assumptions, we replicated ' the' experiment 
described abov.e, with several modifications, The most important 
modification was the • requirement that subjects provide verbal 
protocols of their thoughts while attempting to verify, test 
inferences. In particular, subjects^ere asked to indicate how they 
knew that a test inference was t.rue or false. This T^rodedure 
permitted precise determination of whether a correct response followed 
from correct reasoning from the appropriate facts or from \ome other 
(invalid) process. The protocols' also provided a detailed record of 
the decisipn processes underlying subjects' judgments of individual 

« 

test inferences. Thus, analysis of the protocols provided a basis for 
modeling the observed , ^differences-^ in .performance in the TEXT and 
MEMORY conditions. . 

» • . 

EXPEKIMENT 8 \- * 

Ma terials . Four pairs of texts conceriVing the mythical country 
Morinthia were used (See Chap. IV). Each individual text was about a 



• • ^ • 102 

.dit ferent topic> but the te^ts • within a pair were about related 
topics. The four pairs of topics were (T) The First Morinthian 
Revolution^ and The Imprisonment of Albert Profiro; (2) Religious 
Customs and « B^liefs^in Morinthia, and Religious Overtones During^he 
Fever Elpidemic in Morinthia; (3) The Marriage of Princess Isadora, 
Successor to the Throne, of Mprinthia, and The Roraaiice Betweep Priivcess 
•lathilde and Basil; aYid (A) The Provincial, Lifestyle in Morinthia, and 
The Morinthian Home of the Caledi^n Ambassador. 

Each pair of texts included four pairs of critioal facts, such as 

(1.) and (2) v^bave. Each pai*r of critical facts contained the 

' ' ' ^ \ 

information necessary to support ,a particular* true inference not 

• /( . ' ' -* * ' 

explicitiy^tated m either text (such as <3) above). One set of 

texts* (al>so used in Experiment 7) was shown earlier, on p, 

• G * ' \ ^ 

Procedure., Subjects we "e tested individually. Each subject was 

given a booklet containing the experimental texts and the inference 

tests. . Subject^' progress through the booklets was self-pirced. 

Subjects were informed of the jLjatuie-rf.~tlie> jjif^r^ test they would 

be given. . • . . 

Subjects'studied each pair of* texts as follows- Those in the TEXT 

condition simply scanned the two textdv Those in the MEMORY condition 

read the -two texts • carefully , attempting to learn as much a>5possible. 

After studying each text, these subjects completed f ill-in-the-blanks 

tests of the information they had read. Then they referred back to 

the texts and corrected any errors they had made- The purpos-e of the 

tests was "'simply to maximize the probability that subjects committed 

individual facts from the tpxts to memory.. Thereft)re, th^ test items 

tested memory, for arbitrary information from ^individual sentences in 

the texts. They did not test any i^iferential knowledge, nor did they 

test information necessary for verifying inference^ on the subsequent 

inference test. 

♦ 

After studying a pair of texts, subjects verified (judged true or 
false) true and false inferences derived from the texts. True 
inferences were 'defined a-s those tha^ could be proved true, given the 
information in the .texts, as illustrated by (3) abov^. False 



infereaces were' defined as thp^e that could not be proved true, given 
the -information in the texts, as illustrated by the following ejfample. 



(4) Hh/e Mqrinthian people were\ ^rown in^ a frenzy by 
^Ibert JProfifo's imprisonmejit . * ^ 



/ . 

. / on 



There 'were four true and four false inferences, ^ordered randomly,/ oh 

the ^st following each pairs ol texts. Subjects in the TEXT condition 
. were encouraged to consult the studied texts during the inference test 

in order to determine the validity of^'or verify their * judgments of 

test inferences. Subjects in the MEMORY condition were not permitted 

t9 look back avt the texts. All subjects were urged to prod^e a 

conTTnuous verbal description of their thoughts while^ performing the 

, inference Cest, These protocols were tape-fei6orde\i and subsequently 

transcribed. Thj>s study-test procedure was repeated for each of the 

four pairs of topically related texts. .. . 

After subjects had studied and been tested on all texts, they 

were given a free recall test for the first text in each of tbfe pairs 

of texts they had studied. Subjects were given the tiati£::^f each text 

and instructed to write down everythi.ng they could remember from the 

. i ^ * . - - 

texti ' ^ • . 

Finally, subje^s were ^iven test of the . inferences in 

syllogism form. On this tifrst , each inference was ilfimedia<ely preceded 

hy the two facts that presumably .determined its valiKlity. True 

inferences wefre preceded by the critical facts that supported them, *^s 

illustrated by the sequence (1), (20,. (3). False inferences were 

preceded by. facts ta^en from the texts that ^ were related tos the 

inferences but did not validate them, as illustrated by the ^oll^wing 

-» < • 

sequence : ^ 



The Morinthian peojile were thrown into a frenzy by the . 
imprisonment of the peasant who poached the chickens. 

Albert Profiro^was thrown into prison. 
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*(4) The Horinthian peopll were thrown iato a frenzy by Albert 
Profiro's imprisodment* 

; ' ■ ■ ' - ■ ■ > • ■ 

Subjects simply indicated whether ' or* not each inference followed 

* • ' ""^ • 

logic<llly. from the two facts that preceded it. * - • 

Desi gn. A within-subject design was used. The one independent 

variable manipulated w^s study-test condition (TEXT versus MEMORY) • 

All subjects worked with all four pairs of ^exts described above. 

l^Ha.lf the^ subjects worked ia^the TEXT condition f ft^ the first two pairs 

and in the MEMORY condit^n for the second two pairs , while the other 

half worked in the reverse order. In addition^ Vithin each of' these 

two groups, each pair of texts occurred in each serial position for 

one of the subjects, ^ree vjrecali of the first text in each pair:^ 

occurred in the order' of original pres^tation of tUt pairs of texts 

Subjects . Seven UCLA undergraduates and one Santa Monica 

College undergraduate served as 'subjects. Subjects were^ paid $6^00 

for the two-hour session. In addition, subjects were given a ^oT^ 

bonus, for each correct answer above 50 percent. * . . ^ 

ResQlts ana Disc ussion . - 

- ^ ' ^r-^ — '-^ ^ • . 

Table 5 . i show? proportions of correct judgments ,of triie and 
false test inferences in/the MEMORY and TEXT conditions. These data 
represent orjily those test inferences . to .which s;ubjects ^ responded 
correctly on the final sylf^ism test. That is, inferences for which 
^subject could not perform the necessary reasoninjg correctly or for 
ch the subject disagreed' with the experimenters^ reasoning were 
ejccluded from the analysis. tAccurac^on the syllogisms was above .98 
and Indistinguishable in the two^ conditions.) Thus, the observed 
differences in performance in the two conditions reflect only 
differences in subjects' ability to ret:rieve the critical facts 
necessary to verify inferences, not differences in subjects* ability 
to perform the necessary reasonings on those facts. ^ 



^whi 



^ Tabl« 5.1 

* ACCURACY ON TKUE AND FALSE INFERENCES 



Condition 



Measure . MEMORY' • ".'EXT 



Cpjpt^t responses V ^ 

to true inferences '< ...82 .62 
^ Correct responses . . ' 

to false infefeuces .82 .87 • 

Correct justif ication^ 

o^ true inferences .75 .48 . 

The first two rows in Table 5.1, give proportions correct for true 
and ^Ise inferences.^ ^The third row gives proportions of correctly 
justified true inferences .• ^ These proportions are '»explained , and 
discussed below. "All ' conf Science ievfels reported in this ai.d 
suba^queiiL sections are based on two-L.) iled, "^raatch'ed-pa-ir^ t-tests. 

•Considering fj.rst the simple proportions correct for true and 
false inferences, the results of the present experiment go beyond mere 
replication of the results discussed above. Again, no difference was 
observed 'betweferi ^^portions correct on false inferences In. the MEMORY' 
and TEXT conditions (.82 versus .87), t(7) = .45-. Hov>ever, the 
proportion correct on true inferences was significantly higher in the 
MEMORY condition ( .82) than 'in the TEXT .condition (.62), t(7)=2.43, 
P|^-05. Thus, the experiment replicates *the observation^ that the 
availability , of reference^ texts during {j,nference verification does not 
impifbve performance over the case in which the information in the text 
must be referenced from memory. It also indicates that in some cases, 
exactly :the opposite occUrs: Storing and .referencing the information 
from texts in memory can improve performance over that obtained when 

the texts themselves are available for refererice. 

/ ' 
The third row in fablp .5.1 gives the proportions of true 

inferences judged to be tr.ue and correctly jus*ifi.ed. Correct 

justification was operationalized, using both strict and. lenient 

criteria, as follows.^ Under the strict criterion, a true judgment was 
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« * * 

considered correctly justified only if both of the.,critical ^acts 
underlying the iuferonce werf^ explicitly sCated in* the protocol and 
^Ugjked togeUfr with appropriate logic, as illustrated in the 
following example: , ;^ * *. 

• • ' • V ' • . - 

Inference: Anastacia DeVillfe was an ertemy^^pX-t^Te^TcTng. 
Fact I: It. was in prison th^X-Albeft Profiro 

^met Ar^as.taeta^^Viile» 
Fact 2: The Mordnthian prison was^populated ' j 
exclusively by enemies of the king, 

Prbtofor: . . 

Well, tha^^ would be true because I remember reading in 

the other story that everybody that was in prison was an 

I. . * ' 

enemy of the k*ing, and^he'ipet her when he was in prison, 
so she was an enemy of the king, , So thaf^s true* 

/ 

Under the lenient criterion, a true judgment ^^as consi^red correctly 
justified if at least one of the critical facts was stated in the 
protocol and the other was implied in what appeared tJo be a logically 
correct account, as illustrate^ in the following -example: 
••. « 

Inference: The Curfew £pisode^as a failure, ' ^ 

Fact 1: The Curfew Episode wa^ a revolution. 
Fact 2: All Morinthian revolutions were doomed 
to f ai lure . 



Protocol 



Well, I would say that's , true because I remember 

reading at the end of the first story that the Spring, 
If * ■ • 

Episode was a failure as. was (sic] all the ot))er 

revolts. So that kind .of predestined the fact that 

every, every' one' of those things would be a failure. 

Implicit Critical Fact: The Curfew Episodf\as a revolution. • 
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Two\ independerit judges were in perfect agreement regarding the 

correctness of justifications according .to both criteria. The lenient 

criterion \ produced' a slifghtly smaller difference between accuracy , 

rates in the MEMORY and TEXT conditions, but the ^pattern of' 'results 
. H ■ /- . / ' - 

.was the same under both criteria. In addirion, both judges felt that 
' '• . 
the lenient criterion provided a mqre accurate evaluation of subjects'' 

justifications i. 'Therefore^ the » lenj-ent criterion was arbitrarily 

adopted and the data r^orted in Table 5.1 reflect measiirements under 

that criteric/A. (Judgm^ents of false inferences were not eval-uated for 

correcfr«ess of Vi'^jstitication because of ,the difficulty of ' 

operationalizing correct justification for them.) * 

The proportion of correctly justified true inferences is a more 

m 

precise measure of subjects' knowledge than simple proportion correct 
because it. excludes both false alarms and' . imperfectly reasoned 
responses. The proportion of correctly justified true' inferences was 
significantly -higher in ^ho MF.MORY condition (.75) tl^an iri the TEXT 
condition (.48), l(7) - 5.65,* p <.01. These data* indicate bl^t 
subjects' superior' performance in the MEMSfty condition is a" 
consequenc^ of their superior ability to identify the, critical facts 
underlying true inferences. . - ✓ 

• These data support pur two basic assumptions. Subjects' • use of 
ineffective sear'^h procedures presumably impedes detection of the 
critical facts underlying ^rue inferences, ^^onfigural memory 
mechanisms organize many learned facts, preSfiiably facilitating 
detection the critical facts underlying true test- inferences. 
Because subjects had to rely primarily on ineffective search 
pVocedures in the TEXT condition, they should iivcorrectly jud|e many 
true inferences to be false. In the MEMORY condition, on the other", 
hand, subjects should benefit from configural memory mechaiiisms, 
correctly judging -^most true inferences to be true. Perf ance on 

4 

false inferences should not be- af fecbed The results described above 
follow directly:. While subjects performed comparably well on false 
inferenci?^ iU' the two conditions, they performed better on true 
infei^erf^es in the^MEMORY condition than in \he TEXT condition. 
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• • • ~ 

Protocol Analyses * . 

». As . discussed 'abQve, subjects provitled verbal protocols, of their 
... ' ' ■ • . . 

decision processes during infereitc^ v«rif ication. We analyzed these 

protocols in order to get a better understanding of the decisio;^ 

.processes and te provide*- more detailed support for the ptoposed search 

and memf^ry mechanisms. This analysis revealed six distinct types of 

decision processes. "Automatic retrieval of bath critical facts" and 

"seatch foHowed by automatic'*retr,ie\s^l" were based on the conf igural 

memory mechanisms described above. . "Successful fact search" and "fact 

search failure" were b^sed on Aeuristic^ ^earch procedure's. "Inference 

search failure" was J)aSed on, anWwjfective search procedure. "FaJlty ^ 

reasoning," as, its name suggests, reflected logical errors, table 5.2 

^SH(mnari2es the six decision processes and the*^ judgmen^ they support. 

We characteri|e each decision process briefly below. 



Table 5.2 • ' . 

* 

JlJDGMENTS OF TRUE AND FALSE INFEREiNCES 
PRODUCED BY SIX DECISION PROCESSES 



Decision Process 



Validity of 
Test Inference 



True 



False 



Automatic retrieval of 

both critical facts 
Search followed by 

automatic retrieval 
Successful fact search 
Fact search failure 
Inference search failure 
Faulty reasoning. 



TRUE 

TRUE 
TRUE 
FALSE 
FALSE 

true/fAlse 



• * • 

' FALSE 
FALSE 
TRUE/FALSE 



Automatic Retrieval of Both Critical Facts. True judgments were ' 
considered to haye been based on automatic retrieval of an integrated 

• # * 

memory representation of the two critical facts underlying tl^ test 
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inferen/> if tlie subject verbalized only tjiose critical facts, as 
illustrated in Che following protccbl: • • 

True Inference:- Albert Profiro hated King Egbert. 
^FactM: Albert Profiro hated all. dictators. 
Fact 2: King Egbert was a dictator. 

Protocol ; > • • , 

* 

True, because King Egbert waV a ..dictator and Albert 

, Profiro hated ail dictators; - So it's -true. 

We assume ^at this decision process involves no conscious search for 
relevant facts. There' is -no indication that the subject considered 
any other related facts in the attempt to verify the test inference. 
Rather, the subject appears to, have been able to retrieve the two 
critical facts automatically on presentation of tl^ test inference.' 

Sgllfch Fo llowed by Automatic Retrieval.' True 'judgments were ' 
considered f. have been based on a combination of search and automatic 
retrieval it" (a) the subject verbalized one or more facts that were 
related to the tesd inference before verbalizing the first of .tlie -two 
critical .tacts underlying the test inference, and (b) ,the subject did 
not verb.rliije any other faffts between verbalizations of the -^wo 
crit ical~,f,ices. This decision process is illustrated in the 'following 
protocol: ' • . ' ■ • 

True- Inference: The Caledian A.nbassador ' s house was' sur- 

rounded by lilies. 
Fact 1: The Caledian Ambassador's house was 

surrounded^^b^t^ose flowers that were 
prevalent in Morinthia. 
Fact 2: A species of lily was the prevalent flower 
in Morinthia. ^ 

• - - ■ •> . ' 

Protocol ' ^ ' 

OK, they isaid he had fences and ... uiiN in Morinthia 



no 



they h^ve fences and they put plinta or flowers around, ii^ 
their> no, vines and they're twined through their 

fences. Urn, ... Ke had ' fences. OK, . the cottage had 
fences and lilies aren't vines so they can^t intertwine^, 
through ^is fence* He had, I remember they said he had 
typrcal vegetation of MoriKthia. , And since lilies were 
one of their best flowers, the ones they liked and he., had 
typ£t:dl vegetation, then I say the statement is true He 
grew lilies. ' . » 

* ' • . \ ■■■ ' ■ 

We assume that J:his dec^^ipn process involves an initial search of 
either >tKe texts or memory for relevant information^ In the protocol 
above, the search appears to have been for relevant facts, although, 
in other .cases, it appears to have been f or^ the test inference itself^ 
In eith^r^ case, the initial ^earch leads. to detection of one of the 
two .critical facts necessary to verify th< test inference. That fact 
then . cues automatic retrieval of the integrated memory representation 
of both cYit^cal facts, 
^ Succes sful Fact Search, True judgments were considered to have 

been based on successful fact search if the subject verbalized one or 

« 

more facts that were related'^to the test inference before verbalizing 
each of the two critical facts, as illustrated in the^ following 
protocol : . ^ - 



True Inference: There were berries growing outside of the 

Caledian Ambassador* s cottage. 
Fact 1: The native shrub of Morinthia 

hugged the walls of the Caledian 
Ambassador's cottage* 
Fact 2: Th^ere was also a native shrub, called 
the salsa shrub, that had broad leaves 
and was covered with red berries. 

Protocol: 

OK, that's the second story ♦ Be .sure to look there 

V ■ 
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becaus.e there's iiothing in the first story about the ' 
Caledian Anibassaoo^. So, uiii, (reading.] it talks about -the 
cottage first and, W» lush shrubs hug the walls of the 
cottage. OK,' it \^^s brought out .about flowers that were 
prevalent in Morinttiia. OK, I don't know if those flowers 
had berries or not. \ I look at the first story to see 
that. It doesn't sa^ anything about berries in the second 
•^story. OK, urn, fi|rst story ... They talk about the 
;peoples They, don't |.alk about Ambassadors, althbi|gh I'm 

not siire that Ambassadors are really that much different 
than people. OK, a species o^ lily. Uh, I don't see 
ahything about liliek in the second story. I'm not sure 
that's relevant. OK, ^here's a native shrub, also quite 
popular, called the ^alsa shrub. Its leaves were broad 
and it had berries. Um'^ if that's the same shrub as the 
shrub n the second -^story, I would say that yes, there 
were berries. > ^ 

s » • 

4 * ' • 

Successful fact search reflects ■ active search of either the texts or 
\ i ■ - . . ^ 

memory for both critical facts underlying a true' test inference. 

These searches indicate an awareness that two critical ; facts are 

needed and thai they might occur in either of the two relevant texts. 

Thus, succeSisful fact search reflects a heuristic, rather than 



algorithmic, search proteuure. I-n addition, we assume that the 
occurrence successful fact search implies that the- critical facts 

underlying the \ true test^ inference have not been stored in an 
integrated memory representation.^ Indeed, it is the only wa^ subjects 
can correctly verify true inferences whose critical facts have not 
been integrated in memory. . 

Fact Sea rc h Failure. False judgments were considered to have 
been based oji fact search failure if the subject verbalized a number 
of alternative facts before concluding that the test inference was 
false. A false judgment of a .true test inference based on fact search 
failure is illustrated in the following protocol: 
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True ^Inference: The Caledian Ambassador's cottage was 

surrounded by lilies. ' • 

Fact 1: Ths? Calediarv Ambassador cottage was 

^ surrounded by those flowers tbat were 

*.preyalent in Morinthia. 
Fact 2: The most prevalent flower in Morintl\ia 
. was a species of lily. 

Protocol: 

Uh, the second story* I'll look again* Prolvably should 
remember this by now* Urn, (reading] lush shrubs, again^ 
no^^hing about lilies. ^ He had , a low white fence and 
there's something, in the first' story about fences having 
shrubs over them* Uh, looking at that now* OK, the most 
prevalent flower in Morinthia was a species of lily* OK, 
um, I see nothing abput *.. no necessary implicati^>n 
between ^nces and gates which have vines on them and 
lilies,. So I'd say that^ uh, the Caledian Ambassador's 
cottage was surrounded by l^ies is false. 

Fact search^failure reflects ajrtive search of either the texts or 
memory for facts that are^elated to a test inference* These searches 
also indicate an awareness that two critical facts are needed. and that 
they might occur in either of the two relevant texts. Thus, fact 
search failure also reflects a heuristic serar^^^h procedure. 

Inference, Se arc h Fa ilure. False, judgments were coi^sidered to 
have been based on inference search failure if the subject^ 
expliciJLl^ searched for the test inference, itself* A false 
judgment of a false test inference based on inference search faiMire 
ia illustrated in the following protocol: 

False Inference: The people threw stones during the first^ 

Morinthian revolution. 



Protocol: 

rm going back to the firpt one. because I remember in the 

second one they "threw stones in the street, but I'm not 

\ sure about' the first on<?. So, starting in the middle of 

the page, [reading] "It provided the.... Everyone who 

disobeyed the law was punished severely. The peasant was 

. branded..,.. Tl^e townspeople were thrown into a fren-:y 

• with the severity of the sentence. ♦The, crowd stormed the 

« 

palace." No, they didn't throw rocks.^ It-'didn't say on 
here. 

Inference search failure is based on an ineffective search procedure. 
The subject assumes that if the test inferc^nce were true, it would 
appear, verb^^innf in a text or in memory. Although the subject 
verbalizes several facts from the text, these facts are selected not 
because they might be useful in proving the validity of dhe test 
inference, but rather because the subject simifly happened to encounter 
them while searching for the literal inference. 

Faulty Reasoning. True and false judgments were classified as 
faulty reasojning if there was a logical error in the subject's 
justification of a judgment of a test inference, as illustrated in the 
following protocol: 

. ' ' ' 

True Inference: Albert Ptofiro hated King Egbert. 
Fact 1: Albert Profiro hated all dictators. 
Fact 2: King Egbert was a dictator. 

I 

Protocol: 

OK. In the s;econd sheet, the Curfew Episode, they mf^ntion 
the name Albert Profiro and he, um, he wanted to , . . uh 
... he wanted to talk to the people to tell them, um, to 
return to their homes because of the Curfew law, Um, 
since Egbert :was the ruler, yeah, -was the ruler of 
Morinthia, uw,^he was really strict like I said' before; 
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that is, 'something ^mallt 7i small crime or s6mething 
happens y then they get punished severely; So, urn, . the 
soldiers mistoojc Albert of st^eirting a ri5>t instead of 
telling the people to go hon/e because it's a curfew and so 
he was thrown into prison. ' Therefore, think Albert 
« hated King Egbert because, of* the misunderstanding and how 
bad he had to suffer for At. 

i 

Implicit Unsupported Premises Albert Prof iro would hold 
King Egbert responsible for the misunderstanding and hate 

^ him for it ' 

«. . . 

We anal^fzed subjects* response protocols to determine how often 
each of vtrhe six decision processes occurred. Each, judgment of a^est 
inference was categorized as exemplifying one of the decision 
processes according to the rules described above « Two itidependent 
judges were in complete .agreement regarding the categorization of 
subjects* judgments. Table 5.3 summarizes the results of the protocol 
analyses. Each entry in Table 5.3\»gives the mean proportion of 
responses to each item type that . exemplified each of the decision 
processes. Thus, each column in the table sums to l.O. 

Table 5.3 

* * 

'proportions of judgments based on each type of decision process 

* 

Condition 

« 



* MEMORY TEXT . 
Validity of Test Inference 

Decision Process * True \ False True False^ 

Automa.tix^-V^tHr4ev»l -of . 70 ... .11 ... 

both critical facts 

Search followed by .05 ... .28 

automatic retrieval 

Successful fact search .00 ... .09 

Fact searcli failure .05 .46 .04 .25 

Inference search failure .12 * .33 .30 .55 

Faulty reasoning .09 .21 - -19 .20 



1.24 
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In the MEMORY condition, 70 perce;it of all .judgments of true 

ij^f^'^J^ces correctly justified true judgraenj.s based on automatic 

^ retrieval of both critical facts. The -remaining judgments of true 

inferences were iairly evenly ' distributed among /the remainiVg 

categories of decision processes Correct jiyigments of false 

. inferences were . primarily based on a f acj: search t^ilure^ "(.46). 

However, there were also large nvunbers of. judghients based on* both 
•■' » , .1" . , • 

inference search failure and 'faulty reasoning .'. 

< • .- , .» ^ . .<.'"•• 

In the TEXT condition, most judgment^ ,bf true inferences were 

either "true" judgments based oa 'search followed by automatic 
retrieval (.28) or "falsel' judgments based on 'inference search failure 
• ' ' •(•30). The remaining judgments' of true inferences were fairly evenly 
distributed among the remaining categories of decision processes . 
^^'^'^^'^t judgments of false inferences were" primarily based on 
inference search failure (.55,). However, there were also large 

"""bers of judgments based on both fact search failure and faulty 

♦ 

reasoning. 

The overall pattern of fesult^shown in Table 5.3 is consistent 
with the proposed account of performance of the inference verification 
task. In the MEM'ORY condition, subjects performed well on the true 
inferences because .they had good memory for the critical" facts 
underlying the inferences. In the TEXT condition, subjects performed * 
poorly, on the true inferences because they had poor memory for the 
critical facts. In neither condition did subjects perform well on • 
• >^ true inferences by applying effective search procedures.. Similarly, 

subjects performed reasonably well on false inferences only because 
the ineffective search procedures they applied in both eonditions 
happened to lead to the correct judgment (false). These conclusions . 
are supported by the following separate analyses of decision processes 
underlying correctly justified true judgments and those underlying 
false judgments and incorrectly justified true, judgments. 

Pggjs^o" t Processes . Undferlying Correctly Justified True 
.. ^yiJS51?IlLs • ^ble 5.4 shows the conditional proportions >f correctly 
justified true judgments based on each of the three decision processes 
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that produced them. In the MEMORY condition, 93 percent of all. 
correctly justified true judgments w^re. based on /automatic retrieval 
-of both critical facts underlying the inferences. In fact, for six of 
the eight subjects, ?11 correct^justifications of true inferences were 
based on this decision process. Only two* of the eight subjects* 
^engaged in any search activity at all during correct justif icatipns of 
.true inferences in the MEMORY condition. An additional 7 percent of 
correctly justified true judgments in the MEMORY con<3|ition Wjere biased 
on search followed by auUomatic retrieval. Summing the two, all 
correctly justified triie ' inferel^Ces in the MEMORY condition can be 
attributed to Configural memory, mechanisms . In the TEXT condition, 
only 28 percent of all correctly justified true judgments wfere based 
on automatic retrieval of both critical facts. However, an additional- 
58 percent were based on search followed by. automatic ' retrieval. 
Summing the two, 86 percent of all correctly justified true . inferences 
in the. lEXT condition can. be attributed to configural memory 
mechanisms. Only thr^e of the eight subjects perfoi;fi)ed any successful, 
searches at all. The difference between the proportions of correctly 
Justifieicl true judgments attributable to configural ofiemory mechanisms 
in the two conditions is aQJL_signi£icant , t(7)=1.82, p > .1. , 



Table 5.4 



\ 



PROPORTIONS OF CORRECTLY JUSTIFIED TRUE 
JUDGMENTS BASED ON EACH TYPE OF DECISION PROCETSS 



Condition 



Decision Process 

Automatic retrieval of 
both critical facts 

Search followed by 
automatic retrieval 

Successful fact search 



^^EMORY 
.93 
.07 
.00 



TEXT 



.28 



.58 



14. 
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These results support our claim that subjects'. correctly 
justified true judgments derive from automatioally cued memory for the 
critical facts urider lying the test inferences, rather than from*bearch 
procedures that detect/CHe critical; facts. Cowrectly justified true 
judgments in both conditions were produced almost exclusively by 
decision i^roces&es based on configurdl memory mechanisms. Thus, as we 
have suggfested, subjects' excellent* perfqrraance. .in. the MEMORr 
condition reflected their havinf learned the critical faces' underlying 
t^st" inferences and, consequently, their ability to exploit c.^nfigural 
memory mechanisms. In the TEXT condition', on the other hand, stibjects 
made no effort to learn the information in the texts they studied. 
Therefore, their knowledge of the! critical facts underlying test 
inferences and their ability to exploit configural memory mechanisms 
were critically dependent upon incidental learning. Interestingly, 
virtually all (86 percent) of the correctly justified t:^ue judgments 
in the TEXT condition were based on incidental learning of .the 
critical facts. Apparently^ incidental learning was reasonably high 
as a- consequence of subjects having searched each pair of source texts 
eight times (four times for true test infer'ences and four times for 
false test inferences). 

Analysis of the temporal^ intervals separating particular' 
verbalizations during inference verification provides additional 
^upport for this position. The proposed model assumes that automatic 

retrieval of both critical facts' involves no search activity,. 

.'J 

Retrieval of the tWo critical facts presumably occurs simultaneously 
on presentation of the test inference. Therefore, the temporal 
intervals preceding verbalizations of the two critical facts should 
not include any search time. That is, the temporal interval 
separating "offset" of the test inference from "onset" of 
verbalization of the first critical fact and the temporal interval 
separating offset of verbalization of the first critical fact from 
onset of verbalization of the second critical fact should not include 
any search' time. 

The model does not predict that these 'Verbalization times" 
shpuld be zero, because factors other than search activity Influence 



verbalization tines. For exanple^ determination that the information 
retrieved constitutes justification of ^he test inference^, formulation 
of a verbal description^ and initiation of verballifStion should take a 
certain amount of time. Even a binary OU)/NEW recognitioij^ judgment ^f 
simple sentences can take on the order of .1.5 seconds (cf. Aaderson^ 
1974). Inference verification judgments are considerably more complex 
tjian recognition '•judgments. In addition, verbal justifications are 
^considerably more complex than the simple buttpn-pressing response 
typically required in recognition paradigms. Therefore,' we would 
expect Inference verification t^o take cons'iderably longer than the 1.5 
seconds required for sentence recognition. . - 

Another factor influencing .verbalization times is . time 
constraints. Obviously, verbalization times would be shorter if 
subjects were constrained to respond as quickly as possible! Subjects 
were under no time constraints in the present experiment. Quite the 
contrary, they were being rewarded for accuracy only. They were free 
to pace themselves, however they liked, and they apparently took their 
time. ^The mean response/ time (interval between offset 'of the 
inference and verbalization of the judgment "true") for correctly 
justified true judgments was 28.8 seconds in the MEMORY condition and 
■'42.3 seconds in the TEXT condition. ' 

. For the above reasons, we arbitrarily set a criterion time at 5 
seconds. Verbalization times under 5 seconds were taken to indicate 
automatic retrieval; those over 5 secondl»s.vere taken to indicate the 
occurrence of search activity. This criterion seemed to be reasonably 
conse^rvative and w^s decided upon "before ^ny times were measured. 
V Table 5.5 lists the propdrtions of correctly justified true* 
judgments for which verbalization times for both critical facts, only 
the second critical fact, or neither critical fact were less than 5 
seconds. Note that the proportions in Table 5.5 correspond directly 
to those, in Table 5.4. True judgments for which -verbalization times 
for both critical facts were less than 5 seconds correspond to 
automatic retrieval of both critical facts. Those for which . only 
verbalization times. 'for the second critical fact were less than 5 




secoadt correspond to search followed-^ automatic retrieval. Those 
for which neither verbalization time was less than 5 seconds 
correspond to successful search. 



Table 5.5 

PROPORTIONS OP VERBALIZATION TIMES LESS THAN FIVE SECONDS 
DURING CORRECT ^JUSTIFICATION OF TRUE INFERENCES^ 

Conditid'n 

Critical Fact , MEMORY . TEXT 

Both critical facts n73 .20 

, Fact 2 onXif ' . .16 .51 * " 

t Neither critical fact .11 ^ .29 



According to the 5-second criterion, 73 percent of all correctly 
justified true judgmerits in the MEMORY condition involved automatic 
retrieval of both critical facts. An Additional 16 percent involved 
search followed by automatic retrieval. Sunvning ^he two, 89 percent 
of all correctly ji^stified true judgments 'in t.he MEMORY* condition can 
be attributed to configural memory mechanisms. In the TEXT condition, 
only 20 percent of all correctly justified true judgments involved 
automatic retrieval of both critical facts. However, an additional 51 
percent involved search followed by automatic retrieval. Summing the 
two^ 71 percent of all correctly justified true judgments in the TEXT 
condition can ie attributed to configural meinory mechanisms. The 
difference ^between the proportions ^ of correctly justified ' true 
judgmen|:s . attributable to configural memory mechanisms in the two 
conditions is not significant, t(7)=1.48, p > .1. 

These results provide additional support for the claim that 
subjects*- correctly justifie^ true judgmehts derive from automatically 
cued memory for the critical facts underlying the test inferences, 
rather than from search procedures that detect the critical facts. As 
suggested by ,the protocol analyses desci^ibed above, the majority of 
correctly justified true judgments in both conditions were produce(l by 
.decision prooessers based on configural memory mechanisms. Note that 
Khe proportions of judgments attributable to configural memory 

... ■ ' ' 



mechanisms shoj/n in Table'' 5. 5 are somewhat , lower than^those in X^ble 

5.4. However, the pattern of estimates is t^e same. * In the MEMORY 

..ccxndition, most correctly justified* true judgments involved automatic 

retrieval of both critical 'facts , while a smaller; number involved 

sjearch followed by automatic retrieval. In the TEXT condition, mopt 

correctly justified true 'judgments ^involved search followed by 

automatic retrieval, while a smaller number involved automatic 
retrieval of both critical facts. , In both tables, the total 

proportion of , judgments attributable to confi-gur'al memory mechanisms 

was slightly and non-signif icantly higher in. the MEMOBY condition than 

in the TEXT condition. The only noteworthy 'difference between the 

results shown irr Table 5.4 and tho se in Table 5*5 is the suggestion in 

Table 5.5 that a fair number of correctly justified true jvi^dgments in' 

both conditions may have involved successful search. However, this 

may be a* consequence of our having set the S^second criterion too low, 

underestimating the time spent formulating- and » initiating a 

verbalization in the absence of £peed stress. . .. 

Decisio n Processes Underlying False and Incorrectly" Justified 

True Ju dgments > TabLe 5.6 shows the conditional probabilities that 

false judgments and incorrectly justified true judgments 'Were based on. 

each of the th^ree decision processes thaj: produce these judgments. In 

the MEMORV condition, 39 percent of these judgments were based on fact 

search failure, 36, percent were based on inference search failure, and 

I 

25 percent were based on faulty reasoning. In the TEXT condition, 18 
percent of these judgments were\ based on fact search failure, 57 
percent on inference, search failure, and^ 25 percent on faulty rea- 
soning. The difference between the proportions of judgments 
attributable to fact search failure versus inference search failure in 



Table 5.6 



PROPORTIONS OF FALSE AND INCORRECTLY JUSTIFIED TRUE 
JUDGMENTS BASED ON EACH TYPE OF DECISION PROCESS 



Condition 



0 



• 



Decision Process MEMORY TEXT 

.Fact search failure ' .39 • .18 

Inference search failure .36 .57 

Faulty reasoning .25 .25 
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the two conditions is not significant, t(7)=l,23, p > .2. Obviously, 
faulty reasoning also occurs*, comparably oft^n in the two conditions. 
These results, support our clafim that subjects' false judgments 
- and incorrectly justified true judgments de«iv6 primarily from 
ineffective search procedures and' logical error§, rather than from 
errors during execution af an effective search algorithm. It should 
also be pointed out t,hat our classification criterion for inference 
search failure . was conservative. A false. judgment was classified as 
inference seaich failure only if two judges independently agreed" thatT 
the subject had given explicit indication that the false judgment was 
based on failure to fip<tHhe test inference explicitly in the texts or 
memory for the texts ^ Thus,' the proportions for inference search^ 
failure given in Table -5.6 are probably underestimated, while.^he 
proportions for fact search failure are probably overestimated. 'In 
addition, the decision process identified as fact search failure does 

• ... 

• ■ not reflect a particularly effective systematic search procedure 
This decision proccss'was onerationalized simply as consid.- ration of 
..^ ^ " ''^^^^ than one tact tro^j the texts piior to ma.king a judgment of 
"false." No protocol provided any evidence of a subject's having made 
a systematic search of the "available facts, such as that performed by 
the hypothetical computer program,- before rendering a judgment of 
"false." Thus, these results indicate that subjects did not use a-n 
. effective search algorithm in searching either the available texts or 
memory of the texts for facts relevant to verifying test inferences. 

CojPpari sofl qf Jud gmen t Times in MEMORY and TEXT Condition s 

Table 5.7 shows mean judgment times (interval between offset of 
\ the inference and verbalization of the judgment) for correctly 
justified true and correct false judgments in the MEMORY and TEXT 
conditions. These times presumably include component times 
representing decision processes, (search for and retrieval and 
evaluation of memory representations) and verbalization processes 
(determi^j^tion, formulation, and initiation s of appropriate 
verbalizations regarding the decision processes). Because many of 
these components differ for trap and false judgments, it is not useful 
to compare response times for different judgments. However, ' it is 

» * 
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Table. 5.7 

MEAN JUDGMENT TIMES TOR CORRECT JUDGMENTS 

Condition 
. , ' Judgment MEMORY TEXT 

^ . True . 28.8 ' A2.3 

Fartse 20.3 42. X. 



interesting to c«nnpare response times for each of these judgments 
across the two co^itions. ' ^ 

As might be expected, based on the component tides discussed 
above, corfiectly justified true judgments were made faster in the 
MEMORY coridition-^than V the TEXT condition, t(7)'=2.79, p < .05, This 
difference can be attributed to differences in the decision processes 
underlying correct justifications of true; inferences in the two 
conJUtions. Subjects completed their correct justifications of true 
^■inferences faster in the MEMORY condition because those justifications 
were more frequently based on aut|bmatic retrieval of both critical 
facts and rarely involved any search activity at ,all. In the TEXT 
condition, on the other hand, even though most correct justifications 
of true inferences terminated with automatic retrieval of integrated 
memory representations, they frequently began with some kind of search 
activity. Thus, correctly justified true judgments tootc more t;ime in 
the TEXT condition than in the MEMORY condition because more search 
activity was necessary. 

Correct ,false judgments wer^ also faster in the MEMORY condition 
than in the TEXT condition, t(7)=5.34, p < .002. The most reasonable 
explanation for this difference is that the (iecision processes 
underlying false judgments are faster in the MEMORY condition than in 
the TEXT condition. Subjects apparently search memory faster than 
they search a reference text. / 

Memory for. Source Information 

In addition to facilitatiilg inference verification', another 
potential advantage of the MEMORY condition is memory for the 
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information in the* texts. Of ' course, subjects were encouraged tc 
learn the information^^jjn. the MEMORY condition, but not in the TE5 
condition. However » they spent ^a ^ considerable asiount of time 
examining, the texts, even in thfe TEXT condition. This might be 
expected ,to produce some memory ' for the information, artd our 
observation that most of the correctly justified true judgments in th^ 
TEXT c ondition wer e attributable to conf ip u^l memory_^mec^ 
suggests that ^there was incidental, learning in the TEXT condition. 

Subject^- memory for^^j^ 4.nformation in the t^xts was analyzed as 
follows. ^ Tihe\ texts .were brojlen into propositional units (Thorndyke, 
1977), then subject?' recall performancVw^ scored for recall of the 
gist of each^^^position in the appropriate texts. Thus, it was 
possit)le to determine the proportion of propositions recalled by each 
subject in each ^condition. The data are given in Table 5 .8. (Since 
one subject did not have time to perform the^ retail task in thef^ TEXT 
condition, the i Hat a are based on responses from seven subject^,,) 

The first row in Table 5.8 ^hcws reca^^l proportions for the two 
conditions. Recall is considerably better in the MEM6rY condition 
(.61) than in the TEXT condition (.30) ^ t(6)=4.68, p ^ .01. Thu?, 
even though subjects inspected the texts thoroughly *in the TEXT 
condition, they ^learned considerably less than in ^ the HEMORY 

•; S » 

condition, where learning was intentional* ^ * 

The second row in Table 5.8 shows the recall proportions for 
propositions that subje^cts used to correctly justify true inferences 



Table 5.8 
RECAU of. SOURCE TEXTS 

* 

Condition 

MEMORY TEXT 

S 

All propositions , .61 .30 

Target propositions , .80 .76 

^ Non- target propositions , .58 .27 
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in the two conditions, Xhe third row shows the recall proportions for 
propositions that subjects did not use to correctly justify true 
inferences V These proportions approximate the following breakdown, 
t^opositions used to justify tru^ inferences represent those that 
subjects identified as ^'targets** in the text or in memory and used in 
correct justifications of test inferences. Propositions not used to 
justify true inferences represent those that were pimply scanned (in 

rhp TFVT rnnflifion) or i'inriptn>v ed (in th^ MEMORY .condition)^ during 

the inference test. The breakdown is appraximate because other 
praposi^ions must have* been identified as targets for use in incorrect 
justifications of true and false inferences, . Because of the logical ^ 
erro^rs involved in these justifications, the identities of target 
prQpositions were frequently ambiguous. Therefore, we did not attempt 
to include propositions from these justifications in the target group 
but simpl^^^ ' classified all propositions not used in correct 
justifications of true inferences as non-targets. As a result, the 
observed differences between recall of target and non-target 
proj^asitions. discussed below, is probably smaller than the actual 
di^^ference. ^ - 

In both conditions', subjects learned target propositions. Recall' 
of target propositions was high, on the order of 80 percent, in both 
conditions,, t(6)^ ,32, This suggests that identifying a proposition 
as the target of a search (either in memory or a text) aqd using it in 
a correct justification is a powerful learning eitperience. This 
finding is consistent with other studies (cf, Anderson & Biddle, 197^; 
Frase, 1975;' Frase & Schwartz, 1975), indicating that subjects retain 
information that directly relevant to post-test questions better 

than they retain other information from studied texts , 

Subjects also lear<xed many non-target propositions in the MEMORY 
condition, but not in the TEXT conditioa^ Recall: of non-target 
propositions was 58 percent in the M^IMORY (Condition, \compared to 27 / 
percent in the TEXT condition, t(6)=4,26, p < ,01, Tnese data suggest 
that subjects who inspect a text with the intention of learning the 
information it contains retain a considerable amount of that 



information even after a relatively 13hg retention interval (30 to 90 
* minutes) filled with highly interfering memory and inference tests. 
. By contrast, subjects who thoroughly and repeatedly search texts for 
information relevant to particular inferences learn very little of the 
information scanned. 

It might be argued that target propositions were recalled better 
than non-target propositions simply because ^hey were verbalized by 
the "subject duri'h^ the inferencT^test" ^However^ jTn ~the TEXT 
condition, virtually all propositions occurred at least once and most 
occurred several times in subjects' protocols, yet recall of target 
propositaons was substantially higher than recall of non-target 
propositions. Thus, it is not simply the verbalization of a 
proposition that establishes it in memory, but rather its 
identification as a target of the current search. effort and its 
ultimate use- in a correct justification. 

Thus, the higher overall recall probability in the MEMORY 
condition, a.^ compared tp the TEXT condition (first row in Table 5.8), 
is attributaole to two. factors. First, subjects in the M^ORY 
condition identify more target propositions during the inference/ test 
and therefore iearn more of them very well. ' This is a relatively 
minor factor, however, because of the relatively"'sroall number- of 
idcntifijW(? target propositions (approximately 12 percent of all 
propositions in the texts). Tbe major factor is the^ superior learning 
of .non-tar>;et propositions induced by studying the texts prior to the 
infeicnre icsL, compared to the minimal incidental learning of 
non-target propositions induced by searching the texts repeatedly 
during the inference test. 

I nd i_v i duaj D i f f erences 

The proposed model assumes that level ^ of performance on the 
inference test is determined primarily by memory for the facts 
necessary %o verify test inferences. It assumes that effective search 
procedures play a minor role in determining level of performance. 
This model accounts well for the group data discussed above. In this 
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section, we examine the perfo^ance levels of individual subjects. 
There was considerable Variability in the abs^flute levels of 
perf-oirmance ob*served for individual subjects. If the proposed model 
is correct, it should be able ^o account for variation in performance 
level among individuals as well as variation, in performance level 
between MEMORY and TEXT conditions. Individuals with good memories 
should perform better on the inference test^than individuals'" with poor 
memories* The quality qf individuals* search procedures should have 
little effect on performance on the inference test/ 

Table 5.9 presents suimnary data regarding the performance levels 
and memory and search processes of individual subjects. .The first row 
in Table 5.9 records proportion of correctly justified TRUE judgments 
for each subject pooled over MEMORY and TEXT conditions. Subjects axe 
ordered from left to right" in table. 5.9, acco/ding\^^^^to^level of 
performance. Thus, Annie produced the highest proportion of correctly 



justified true 



judgments (.84), while Patrick and Donna produced the 



lowest proportioiiis (.44). 



Table 5.9 * . • * 

SEARCH, MEMOI^Y, AND PERFORMANCE PROFILES FOR INDIVIDUAL SUBJECTS 

Subj-ect 

Measure Annie Paul Brian Eva Betty Tina Donna Patri 

Correctly justified .84 .72 .69 .64 .60 ^ .59 . .44 .44 
true Judgments in ^ 
MEMORY and TEXT 
conditions 

Recall of non-target .78 .83 .65 • .70 .69 .47 • .38 " ,28 

propositions in , ^. * 

MEMORY conditicfn • • / 

Successful search .50 .40 .00^ .00 .33" .4.*00 .00 .00 

efforts in search . . . , 

condition 
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The second row in Table ^.9 provides a measure of. the quality, of 
indiv^idual subjects' menories. Yhis variable is ope rationalized as 
/the proportion of non-target facts' recalled from the texts in the 
MEMORY condition. The measurement is restricted to non-target fact's 
because, as discussed above, memory for target facts is better than 
for non-targets. Since subjects identified different numbers of 
target facts during the inference test, including these facts in the 
.measurement would bias the analysis. The mea-surement is restricted to 
the • MEMORY condition because one subject was unable to ^^-rform the 
recall test in the . TEXT condition, due to lack of time. The 
I)roportion of non-target propositions recalled provides a direct 
measure of the quality of subjects' memories. Subjects who recalled 
higher proportions of non-target propositions have better memories 
than those who recalled lower proportions of those propositions. 

* The third row in Table 5.9 provides a measure of the quality of 
the search procedures employed by each subject. This variable is 
operational ized as the proportion of true test inferences (excluding 
those, correctly justified oii the basis of automatic memory mechanisms) 
that the subject correctly /justified on the basis of successful 
search. Proportion of successful search efforts was computed only on 
data from the TEXT condition, to provide a direct roeasufe^of the 
quality of subjects' search procedures in the absence of anv memo.y 
effects. Subjects who had higher proportions of successful search 
efforts have better search procedures than those who had lower 
proportions. < 

Table 5.9 indicates marked individual differences in the* levels 
of performance and the qualities of the memory and search mechanisms 
of individual subjects. The individual differences appear to be " 
orderly and consistent with the theoretical framework developed above. 
First, performance on the inference test appears to be influenced 
strongly by the quality of a subject's memory. There is a positive 
correlation between proportion recall of non-targrt propositions and 
proportion of correctly justified true judgments, r = .89, p < .01.* 
Second, performance on the inference test appears to be only minimally 
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dependent upon the quality of a subject *s search procedures. Most 
subjects had no successful search efforts, ^and the correlation between 
proportion of successful search effprts and proportion of correctly 
justified true judgments is not 'significant, r = .69, p < .10. Thus, 
as predicted by the proposed model, a subject's performance on the 
inference test was determined by ability ta remember information from 
the stories, not by ability to search effectively for particular 
information, / ^ 

* It is interesting to note that the two best subjects, Annie and 
Paul, had the best search procedures as ti;ell as the best memories. 
There is a significant positive correlation between proportion recall 
of non-target propositions and proportion of successful search 

4 

W 

efforts, r = .72, p < .05. These results indicate that subjects who 
have good memories also tend to have relatively good ^ search 
procedures. Note, however, that teven subjects with good search 
procedures were heavily dependent upon automatic memory mechanisms in 
their efforts Uo verify test inferences. Thus, the highest observed 
proportion of successful search efforts was only 50 percent. Further, 
all three of the subjects who exhibited good search procedures based 
the majority of their correct justifications of true test inferences 
(78 to 90 percent) on automatic memory mechanisms. 

^'t^ACTICAl^lMPLICAjriOI^^^ . * 

Peoples V abi I ity to detect and ^ use logical configurations of 
related facts apparently derives from highly developed memory 
mechanisms/' it is extremely difficult to detect configural 
iriformation in an external information source, such as a text» It is 
much easier for people to detect configural information if the source 
information has been committed to memory* The model proposed to 
account for these e^lects assumes that (1 ) subjects use search 
procedures that are inadequate to detect configural information, and 
(2) automatic memory mechanisms organize acquired facts in memory 
structures that make configural information salient and highly 
accessible. In addition to predicting the details of group 
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performance in the MEMORY and TEXT conditions, the proposed model 
accounts well for individual differences. 
; These results have obvious practical implications for anyone who 

deals with, information and wants to perform more sophisticated 
info^ation processing than simple fact retrieval: People should not 
rely upon the ability to search available informf^tion sources for 
relevant information as it is needed. Host people employ search 
procedures that are inadequate for that task. . Instead, they should 
attempt to commit as much important information as possible to memor^ 
Once information had been memorized, it is available not only for 
simple fact retrieval, : but for more sophisticated information 
processing, such.* as deductive reasoning, as well. These 
considerations are particularly relevant in education. 

» * ■ . - ■ 

The value of "memorization" in education is widely disputed. 
'Those who doubt the value of memorization usually^ase that o'pinion on 
a preference for more ambitious educational goals. Arguments in this 
category usually run as follows. Students sWld understand, rather . 

9 

than memorize, the information they encounter. Students are deluged 
wiEK facts that are related in various ways. These facts arrive at 
different times and in dif ferent* contexts . Students should not simply • ' 
learn the individual facts they encounter-t-they should integrate them. 
' That is, students should construct a meaningful conceptual structure 

. in which individual facts can be embedded. This is what is meant by 
understanding. I It is the basis for the ability to perform 
higher-order information processing, ' such as comparison, 
characterization, ^nd inferential reasoning. Students should learn to 
use facts in these important ways, rather than simply to reproduce 
them. Therefore, it is less important for students to memorize facts 
than it is to know where to find information and how to use it when it ^ 
needed. 

Students frequently offer a similar argument when requesting 
open-book examinations. The claim is that traditional closed-book 
examinations emphasize the ••wrong" thing, namely, memory for specific 
facts. In addition, closed-book examinations encourage "undesirable^^ 
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study habits. Students are preoccupied with fact menorizatio^i, . at the 
expense of efforts to integrate and understand 'the material. 
Open-book exaainations , on the other hand, deemphasize nemory for 
specific facts, since the facts are readily available in the text 
during the examination. Students are freed of the need to spend 
valuable study time memorizdng facts and can, instead, devote that« 
time to developing a better understanding of the material. The 
ope^n-book examination presumably, provides a* good opportunity for 
students to demonstrate this understanding. 

Let us examine these arguments in li&ht of the present research. 
The inference verification task used in our experiment required 
subjects to ut?derstand. and integrate related facts in meaningful 
conceptual structures, to find information when it was needed, and to 
use facts in'«^ sophisticated way. Thus, ability to perform the task 
exemplifies the kind of educational goral advocated in the arguments 
above » The results of *the experiment show that subjects were unable 
to perform the ^ inference verification task when the necessary facts 
resided only in external texts (open-book test). That is, they were 
unable^o integrate facts and understand the relationships arodng them. 
They were unable to find facts that were relevant to test inferences 
and therefore unable to use the facts to verify test inferences. On 
the other hand, subjects performed the inference verification task 
rather well when the necessary facts had been learned (^closed-book 
test). They were able to integrate learned facts and understand 'the 

relationships among them. They were able to retrieve facts that we?* 

* * • 

relevant to test inferences and therefore able to use learned facts ^^^6*^ 
verify test inferences. Further, integration of related facts and 
retrieval of televant facts during inference verification appeared ♦ to 
be automatic memory functions, requiring little conscious effort by 
the subject. 

These results indicate that students are poor processors of 
in^mation that resides in an external text but reasonably effective 
processors of information that they have learned. Consequently, 
attempting to perform sophisticated information processing instead 
of learning specific facts, as advocated in the arguments above, may 
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be telf -defeating. Apparently, learning >he individual facts that are 
involved in a cotaplex knowledge structure is an important, and perhaps 
necessary, precursor to a thorough understanding of the relationships 
aaong those, facts. These results also suggest that open-book 
examinations stay not produce their intended effects. The danger is 
that, students will rely too heavily upon the availability of the text 
and f^<ir^o exploit the powerful organizational properties of human 
memory. Thus, students should not forgo efforts to learn course 
material in favor of efforts to understand and integrate it. They 
should work to learn course material, as well as to understand and 
integrate it. . 

In siunmary, the present research suggests that memorizing new 
information is a critical step in the learning process. We do not 
mean to detract from the import«'nce attributed to understanding and 
sophisticated information processing i^^/'educatibnal goals. On the 
contrary, we agree that simple fact acquisition is an impoverished 
educational goal. Good understanding of acquired information and, 
perhaps more importantly, the ability to apply acquired information 
should^ be the ultimate goals. However, the present results suggest 
that the&(s goals are best achieved when they, are predicated on a 
strong foundation of initial learning. 
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VI. TEXT ANNOTATIOH; A TECHNIQUE FOR FACILITATING 



* KNOWLEDGE INTEGRATION 'ii 



ERIC 



Chapters IV and'V focused on the process of integration of 
information in ^ text. This chapter investigates a technique for 
I improving subjects' integration of knowledge. Earlier studies of 
integration typically required subjects to study a text containing one 
or more of facts from which particular inferences could be 

deduced (e.g., Brans f o rd & F^ahks, 1971; Frase/ 1969, 1973, 1975; 
Haviland & Clark, 1974; Haye^Roth, 1977). Subjects were then tested 
on their j<knnwledge of these inferences. For instance, Frase (1969) 
presented subjects with brief stories like the following: 
\ . • • . ' ■ • 

The Fundalas are outcasts from other tribes iji Central 
Ugala. It is the custom in this part of the country to get 
rid of certain types of people. The hill people of Central 
Ugajla are farmers. The upper highlands provide excellent 
soil for cultivation. The farmers of this' country are peace 
loving, which is reflected in their artwork. The outcasts 
of Central Ugala are all hill people. There are about 
fifteen different tribes in this area* (p. 2) 

» < 

Later, subjects were tested for their /knowledge of inferences such as 

(1) The Fundalas are hill people 

f 

which follows from 

/ 

(2) The Fundalas are outcasts from other tribes in Central Ugala 

and 

(3) The outcasts of Central Ugala are all hill people. 
9^ li? 
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Working in a similar paradigm, in ExpiJriment 7, (Chap. XV) we 
presented pairs Je^ related stories,, such as those on p. 89, to 
subjects, who were then tested for their knowledge of the inference 



(4) Albert Profiro hated King Egbert 

. ■ ■ . . ' ■ 

which is based on the facts 

• I. 

(5) King Egbert was a dictator (from the first s^oty^C^ 

and , • 

(6) Albert Profiro hated all dictatory^ (froi^ the second story); 

In both of these studies, successful integration of related ^cts 

permitted subjects to deduce information that was neither required for 

nor suggested by simple comprehension of the texts « a 

Despite the importance of information integratioif, ptfople are not 

very good at it, Frase (1969)^ found that free recall of his ' stories 

included relatively few inferences, eyen when subjects were told 

explicitly to include as many inferences as possible in their recall. 

A' related result depends on the number of inferences to which a 

subject is exposed. If. an inference chain is represented by the' 

linear order A -> B C, a subject verifing the inference "A -> 

during acquisition would be exposed to only that one inference. 

Subjects verifing the more complex inference "A -> E," represented by 

the chain A -> B -> C -> D -> E, should be exposed to the intermediate 

inferences of A -> C, B D, C -> E, A -> D, and B -> E, as well as 

« 

the explicit inference A -> E, One might expect the latter condition 
to produce more inferences on a subsequent .recall test. This did not 
occur. 

Unpublished research from our laboratory indicates similar 
difficulties in information integration. Subjects (UCLA 
undergraduates enrolled in an introductory psychology course) read 
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four pairs of related lltories (the materials illustrated in Chap« IV). 
Four pairs of related facts occurred in each pair of stories, with one 
fact fron each pair occurring in each story. Each pair of facts could 
be. used to deduce an inference, as Illustrated in (4) to (6) above* 
After studying all four pairs of stories, subjects received a 
verification test on the sixteen true inferences and sixteen 
distractors. Eight of the ^sixteen subjects performed. 4t or below 
SiL?.9£^ on this verification test, (as determined by a high-threshold 
correction for guessiog. Green and ^ Swets, 1966). Providing three 
repetitions of each story did little to improve performance: Seven of 
the sixteen subjects still performed no better than chance. 
Performance on inferences was conditionalized on correct performance 
on a subsequent syllogism test. That is, inferences were included in 
the analysis only if subjects responded to. them correctly when they ' 
were preceded by the appropriate facts (premises). Thus, poor 
performance on the inference test was not due to subjects' inability 
to perform ' the » necessary reasoning, but ralher to their failure to 
Integrate the related facts from which the- inferences -could be 
deduced. 

As these studies illustrate, facilitating subjects' integration 
of related facts and deduction of the inferences they entail is an 
Important educational goal. The present reseiirch investigated the 
facilitatlve effects of text annotation. Subjects studied the stories 
described above and attempted to deduce as many inferences from them 
as they could. Then they were tested on their ability to verify 
valid inferences deduced from the pairs of related facts that had 
appeared in the^stories. 

Tho types of text annotation were evaluated. In a FACT 
annotation condition, facts from the first story in a pair were 
repeated in footnotes to related facts in the seconj| story. Thus, 
this condition focused the subjects' attention on pairs of related 
facts. In a FACT- AND- INFERENCE annotation condition, facts from the 
first story were again repeated in footnotes to related facts in »the 
second story. However, in this condition, the repeated facts were 



accompanied by the inferences that cpuld be deduced from the fact 

pairs. Thus ^ this condition focused subjects* attention on pairs of 

related facts and informed. them of the^appropriate inferences as welli 

In a CONTROL condition, texts were not annotated. - 

Although both annotation conditions should produce better 

♦ 

performance than the CONTROL condition, it is not clear which of them 
should produce the best performance. Because the FACT AND INFERENCE 
condition provides subjects with the test inferences, they cannot fail 
to deduce any of them, nor can they • incorrectly deduce unwarranted 
inferences. The FACT condition, by contrast, requires subjects to 
deduce inferenc^ 7 ffor themselves • Thus, subjects may fairj. to deduce 
the inferences or may incorrectly deduce unwarranted inference^. On 
the other hand, the kind of processing activity reqjiired by the FACT 
condition might provide another kind of advantage • Actively deducing 
an inference from two premises is a "deeper" kind of processing (Craik 
& Lockhard, 1972) than simply studying inferences that have already 
been deduced. This kind of activity might increase long-term 
retention ^. (Hyde & Jenkins, Jf<S9) . These considerations lead to the 
following predictions* If subjects in^the FACT condition deduce mo*t 
of the inferences correctly, they should perform at !teast as well in 
the inference test as subjects in the FACT-AND- INFERENCE condition. 
If subjects in the FACT condition do not deduce most of the inferences 
correctly, subjects in the FACT-AND- INFERENCE condition should perform^ 
better. . » 

EXPERIM ENT 9 . ^ x 

Method i 

Subjects. Thirty-six UCLA undergraduates participated in the 
two-hour experiment. Subjects were either paid $6.00 or given course 
credit for their participation. 

Materials . The *tour pairs of meaningful stories about the 
mythical country of Morinthia used in Experiment 7 were used again in 
this experiment. 

Each pair of stories included four pairs of related facts, such 
as (5) and (6) on p. 133. Each pair of related facts contained 
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sufficieat information to deduce a particular inference not explicitly 
stated in either story (aucb as fact (4) above). 

Deajgn. All subjects received all four pairs of stories in an 
order counterbalanced across subjects. To ifwure high retention, 
subjects received three copies of each story, alternating between 
Story 1 and Story 2 of that pair. Subjects were randomly assigned to 
one of the following experimental conditions. 

CONTROL Condition. CONTROL subjects were told (via printed 
instructions in their test-^booklets) that the experiment concerq^ 
their ability to read, uhd^sta|nd, and remember prose; that they would^ 
read a number of stories about /'an imaginary country; and that they 
would later be asked questi^s about the stories. The subjects were 
fi^rther instructed to try to |pombjLne facts from the stories and to 
deduce inferences from combinations of facts. They were told to write 
down any ^inferences they deduced in^ a space prqvided below the 
^ * stories. An example (unrelated to any of the experimental stories:) 

was presented, showing two ^stories with information suitable for 
deducing inferences. Subjects were told that deducing inferences 
^would maximize their performance on the tests to come. 

FACT Condition. FACT subjects received the same instructions 
and test materials as the control subjects , with the following 
additions. The second story of each pair was modified by placing a 
numerical footnote after each fact in the story that Was involved in 
one of the. experimental inferences. This footnote referred the 

K 

0 * • 

subject to a "hint"^< at the bottom of the p^ge, which contained the 
related fact from the first story in the pair. Each of these pairs of 
facts provided the basis for deducing an inference. For example, the 
f^ct '*King Egbert was a dictator,*^ which ^occurred in the first story, 
was repeated as a footnote to the fact "Albert hated all dictators" in 
the second story. Subjects were told to use these hints to deduce 
inferences. They were also told that other inferences might be 
possible, so they should not. r.1^strict their efforts to facts 
associated with hints. Again, subjects were told to write down all 
inferences they deduced in a space provided on the page* 
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FACT-AND- INFERENCE Condition. FACT-ANB- INFERENCE subjects re- 
ceived the sane materials as FACT subjects', with the following 
modifications. The second sentencK42f each pair was agilin narked with 
a footnote, but the hint indicated by the footnote was the related 
fact fron the first story in the |)air and the inference that could 
be generated from* the pair of related facts. For example, the 
footnote to "Albert hated all^ dictators" was "King Egbert was a 
dictator" and "Therefore, Albert hated King Egbert." Subjects were 
' told that these hints w6uld show them examples of inferences deducible 
*from the two stories and that they should learn these. They were a^so 
told to deduce as manj^ oth/sr inferences as possible and write them 
^own in the space provided. 

Procedure > Subjects were tested in groups. Each subject was 
given a^ booklet containing the experimental stories and tests. 
Subjects' .progress through the booklets was self-paced. Intentional 
learning instructions were, given, including the warning that an 
inference ^test would be given. Subjects recorded the times at which 
they began and finished reading each pair of stories. 

After subjects had read all four pairs of^ stories, they were 
^ven combined recognition^verif ication tests. Three kinds of items 
were tested: OLD sentences, which had previously a|>peared in the 
stories; NEW sentences, which were made up of invalid combinations of 
facts from the stories; and the INFERENCES describeii above. Subjects 
l-4ere instructed to use a response line below each sentence to answer 
two questions: (1) Did this exact sentence appear in a story you 
have read (OLD or NEW)? and (2) If not, is the sentence logically true 
with respect to the facts presented in the stories (true or false)? 
Subjects were given both OLD and NEW- TRUE response options to avoid 
confuaion over whether they were being tested for recognition or 
verification. The two kinds of response^ were treated identically in 
«r^the analysis. 

There were .twelve test items (four of each of the three types of 
items) for each set of stories. The test items were blocked by story 
pair, and these blocks were presented in the same order as the story 
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pairs to control fdr any short-term retention of the stories. 
Subjects were not allowed to look back at the ^stories ^t any time 
during the testing. 

Following the recpgnition-verif ication tjCst, subjects verifieJlv. 
the sixteen true and false inferences in syllogism form* That is, 
each inference was preceded by the two facts from the stories that 
presumably supported it. Subjects simply indicated whether each 
inference followed logically from the associated premise sentences. 

Results an d Discussio n 

Inference Deduction, The inferences deduced during learning in 
the CONTROL and FACT, conditions were examined for the sixteen 
inferences around whirch the stories were designed^ (These will bp 
referred to as the critical inferences of the experiment.) FACT 
subjects deduced more of these critical inferences than did CONTROL 
subjects (probability of generation: CONTROL = .40, FACT = \84; t(22) ' 
= 5.14, p .01), although both groups misled a significant number of 
critical inferences (.84 1.0, t(ll) = 3.73, p < .001). Thus, while 
CONTROL subjects deduced^some of the inferences on their own, FACT 
subjects, aided by footnotes referring to previously read related 
facts, deduced many more of the inferences. 

Recognition-Verification Test. The variable o^f interest is the 
probability of a correct response to ^ach of the three kinds of test 
Items. For NEW items, the correct response was NEW^FALSE. For OLD and 
INFERENCE items, the correct response was "true" (either OLD or 
NEW-TRUE). While there are many interesting questions concerning 
subjects* abilities to discriminate sentences they have actually seen 
before from valid new sentences (Brans£ord & Franks, 1971) , our 
concern here is with whether or not subjects- think a sentence is true, 
regardless of their reasons. 

Failure to judge an INFERENCE to be "true" could be due to either 
of two causes. First, subjects may have failed to integrate the 
related facts underlying the inference. Alternatively, they may have 
integratj&d the facts but decided that the inference did not follow 
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from them. Since we are primarily concerned with subjects' ability to 

integrate facts 'and not their ability to reason, performance on the 

syllogism task was used to control performance on the inference task; 

Any inference whose corr^s^ndirig syllogism was incorrect was excluded 

from the ^ ana!^^i:§T''^^hus , the results below reflect performance on 

only those inferenfc^s that the subject believed to be logically valid 

when all the necessary information was readily available. Subjects, in 

the three groups, performed comparably well, on thie syllogisms 
(pCcorrect true syllogism): CONTROL = .92, FACT = ,92, 

FACT -AND -INFERENCE = .96; F(2,33) = 1.27, MSe = .006; p(correct false 

syllogism): CONTROL = .80, FACT = .77, FACT-AND- INFERENCE = .68; 

F(2,33) = .82, MSe = .060, so this conditionalizing did not lead to 

any item selection effects. 

The results are shown in Table 6.1. The probability of a correct 

response was tested in a group (CONTROL/FACT/FACT-AND- INFERENCE) by 

item (OLD/ NEW/ INFERENCE) analysis of variance. Thp main effects of 

group (F(2,33) " 8.87, p < .001) and item (F(2,66) = 240.69, p < .001) 

were significant. In addition, the interaction between group and item 

was significant, F(4,66) =5.05, p < .001. ^ All three experimental 

groups called OLD items "true" equally often (F(2,33) < 1.0). 

However, Newman-Keuls tests (Winer, 1962) found that subjects in the 

FACT and FACT-AND- INFERENCE conditions verified inference^ correctly 

more often than did CONTROL subjects (p < .01). In addition, FAi:T 

Table 6.1 

PROBABILITY CORRECT FOR OLD, NEW, AND INFERENCE 'ITEMS ' 

FACT and 

CONTROL FACT INFERENCE 



p (OLb or TRUE I OLD) .96 ' .96 .96 

p(old or TRUE I INFERENCE) .80 .96 ' .97 

p(NEW and FALSE | NEW) .4f .63 .54 
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subjects correctly classified NEW senteiK^es more ' often th&R did 
CONTROL or FACT- AND- INFERENCE subjects (p < .05). , 

These results indicate that the I^ACT condition produced better- 
overall performaace than either; the. CONTROL or tiie f ACT" AND- INFERENCE 
condition. Subjects in the FACT condition verified OLD sententes as 
accurately as subjects in either of the other two conditions. They 
verified true inferences more accurately than subjects inNthe CONTROL 
condition*, • and they verified false NEW sentences more accurately than 
•subjects in either of the *other two conditions, ^, 4j 

4 

The finding that .subjects in the FACT condition performed as well 
\as subjects in the FACT- AND- INFERENCE condition on the true inferences^ 
is *a little surprising in light of the predictions above ^, i We 
predicted that performance would be better in the PACt-ANl)- INFERENCE 
condition unless subjects in the FACT condition ^orrectly deduced roost 
of the test inferences during study. As noted afbo^^&•r— S4*bj®cts in- tht? 

FACT condition correctly deduced 84 percent of the test inferences 

♦ 

during study. Apparently, the active progressing required to deduce 
inferences in the FACT condition . provided a relatj.vely Itfrge 
advantage. This advantage was sufficient to offset subji^cts* -failure 

to dleduce all of the inferences » permitting them to verify infe^^rences 

' ' ' I ^ " 

as accurately as subject^ in the FACT-AND- INFERENCE condition. ! " 

The importance of deducing inferences during study can be seen T)y 
conditionalizing the probability of judging an inference *to he true on"' 
whether ojr not that inference was Reduced during study (see Tabl^ 
6.2). For both the CONTROL and FACT conditions, the' probability of 
judging a previously deduced Inference true was'' close .to-. 1.0, while 
the probability of judging ojther inferences tx>ue wais around -.70 
(F(l,17) = 19.99*, p <, .000. Neither the group effect nor the 
group-by-deduction interaction was Significant (both F's 1.0). 
Thus, the' difference between the overall performance by CONTROL and 
FACT subjects is due to^the failure, of CONTROL subjects to deduce as 
many inferences during study. CONTROL and FACT subjects' performance 
on^ * previously. deduced i;iferences did not di&fer from 
FACT-AND-INFE^IENCE subjects' overall performance (FU,28) < 1.0), 



indicating that subjects' mepory for deduced inferences was at least 
as good as that for fexplicitly read inferences. ^ ' 

Table 6.2 

PROBABILITY CORRECT FOR INFERENCES 
CONDITIONAL! ZED ON PRIOR DEDUCTION 

FACT and 

CONTROL FACT INFERENCE 

Produced ,96 ,98 ,97 

Not produced ,66 . 75 ' ' 

We must consider an alternative hypothesis for CONTROL subjects* 
relatively poor performance on true inferences. Subjects in the 
CONTROL condition were given -no- inforfiiaticn at all about which 
inferences -weal d be tested- Subjects in thd FACT-AND-INFERENCE 
condition road the test inferences, and subjects in the FACT Condition 
had their attention focused on facts underlying the test^ inferences. 
Perhaps subjects in the CONTROL condition actually deduced as many 
corrtu t intereaces as subjects in the other conditions but did not 
happen to deduce ihoHv subsequently tested. Thus, subjects in the 
CONTROL comlition may not have been fiven an opportunity to display 
thei r know ledge . 

In dtM to test this alternative hypothesis, we scored subjects* 
pertormaiKe for the number of non-critical inferences deduced during 
study. The' number of non-critical inferences deduced decreased as the 
amount of information given in footnotes increased (number of 
non-ciitiial inferences deduced; CONTROL = 15.75, FACT = 13.00, 
FACT- AND- INFERENCE = 10,42), but this effect was not significant 
lF(2,33) - 1.09, MSe = 78,10). Thus, we cannot explain subjects* poor 
pertormance in the CONTROL condition* as a consequence of their having 
gt^nerated the *'wrong** inferences. 
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R eading Times I The tii|ie to read and process pairs of stories 
averaged 1.9 minutes in the CONTROL condition, 2.3 minutes lu Ihe FACT 
condition, and. 2.4 minutes in the FACT-AND- INFERENCE condition. The 
effect of condition Was significant (F(2,33) = 3.21, p < .05), 
indicating that subjects in the two annotation conditions sperit more 
time processing the stories than did those in the CONTROL condition. 
This is not surprising, given the different activities performed in 
the three conditions: Subjects in the CONTROL condi/ion read only the 
two stories and deduced an average of 22.2 inferences (critical and 
non-critical). Subjects in the FACT condition read the two stories 
plus four facts repeated in footnotes and deduced an average of 25.8 
inferences. Subjects in the TACT- AND- INFERENCE condition read the two 
stories* plus four repeated facts and associated inferences in 
footnotes and deduced an average of 10.4 additional inferences. 

General disc ussion 

These results suggest that active efforts to integrate studied 
T^aterial and deduce valid inferences are valiiab^le study behaviors. 
Our subjects* knowledge of previously deduced inferences was nearly 
perfect, while their knowledge of other inferences was only slightly 
above chance. 

Simply instructing subjects tg . attempt to integrate related 
information from studied texts and illustrating how to deduce 
inferences apparently can improve performance. Our control subjects 
successfully deduced 40 percent of the critical inferences without any 
hints at all and, as a consequence, verified 80 percent of the test 
iiVfe rentes correctly. This represented a subs.tantial improvement over 
the performance observed in previous studies in which subjects were 
given more general learning instructions. 

The s impUL.^._aruii>tation techniques illustrated in the present., 
experiment apparently can further improve Subjects' integration of 
related information and deduction of valid inferences. While subjects 
take more time to study annotated stories, we capnot expect to improve 
performance at no cost. The relatively small investment of another 20 
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or 30 seconds subjects made in the annotation conditions paid off in 
substantially improved performance. 

'Apparently, the major impediment to successful performance is 
failure to detect the relationships among separately encountered 
facts, rather than the inability to reason correctly. Thus, it. 
appears that simply pointing out the relationships/among separately 
encountered facts (the FACT condition) is as effective as deducing the 
inferences for the subjects (the FACT- AND- INFERENCE condition). Then 
finding that subjects correctly rejected NEW sentences more often in 
the former condition than in the latter suggests that the simpler 
technique may actually produce the best overall performance. 
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The studies described in this repprt explQred a broad range of 
issues in human processing of knowledge from text. These issues 
include the following: 

» 

• « 

I. Which infonAation people acquire during incidental and 
intentional learning and .^w they acquire it. 
^ 2. Transfer effects in learning from related texts. 
^"^^^ Conditions under which acquired information ca^n be recog- 
nized or retrieved. 

4. Integration of related facts encountered in the same or 
different texts. 

5. Inferencing based on related^ facts encountered in 

i. , • 

different texts. 

6. Searching an external text or memory of a text for infor- 
mat ion relevant to a hypothetical inference, j ^ 

7. Annotation techniques for facilitating inferential rea- 
soning and retention of inferences from information in 
studied texts. 

Throughout ^his report , we have assumed a single , unifying 
theoretical framework. We used this theory to motivate the particular 
experiments we conducted and to account for the results we obtained. 
This theory embodied principles governing acquisition, transfer, 
recognition, and retrieval of information from text, as well as 
specifying the details of the. memory representations on which these 
processes operate. Based on our experimental results, we may j/ow 
summarize the theoretical assumptions that have gained empirical 
support. 

A knowledge structure that represents information from one 
context can be used to represent the same information occurring ,in 
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different contexts./ The information ihared across contexts is 
rejprescnted as a configuration of general, or variable, concepts ^nd 
their relations (a schema). The details that specify or "instantiate" 
the variable concepts in each individual context are associated with 
their respective concepts by context-preserving relations. Vhen a 
detail is associated with a well-leaj^ed schema, the schema must be 
retrieved in order to retrieve the detail that instantiates it. 

The use of a schema for encoding or retrieving ■ information 
depends on its accessibility in memory; that is, the probability that 
it can be activated, either for use in storage "of incoming information 
or for retrieval of previously stored information. ' Accessibility 
depends upon the strength of the stored information, the Went of the 
overlap or match between input' and schema, apd the recency of previous 
activations. Each time a schema is activated for use, it becomes more 
accessible for successive activations. 

When multiple details instantiate a variable concept in a schema, 
they compete with one another for associations with the variable 
concept. As the number of competing details increases, a person's 
ability to discriminate (and thus recall correctly) the context in 
which each det.ail occurred (decreases. Thus, when a schema is used to 
encode multiple complementary facts (as in Chap. IV), memory is. 
enhanced. However, when a schema is used to encode multiple competing 
facts (as in Chap. II), memory can be interfered with. 

Schemata may also be viewed as more global knowledge structures 
t encode entire texts. At this level of analysis, a schema 
provides a framework for sequencing and organizing the events ia a 
narrative discourse. 

The main purpose of the studies described in this report was to 
discover techniques for improving the amount of information people can 
assimilate from texts and their ability to use that information when 
necessary. Based on these studies, a set of principles for improving 
human learning and performance with texts has emerged. These 
principles are listed below, accompanied by brief descriptions of 
supporting data from the particular experiments from which the 
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principles were derived. We believe tli«t these principles could iserve 

* • ■ 

as useful guidelines in designing infonution «yBteair^f the future. 

1 . Presenftion of new informstion in well-lesrned structural 
organizations can facilitate learning of that inforwatioh. 

It is frequently necessary to present, texts, containing related 
facts— that is, facts having the same^^eneral form, but different 
details. For exanple, one might be required to learn a series' of 
profiles of Adividuals in which the fact "He was born in the yiear 
..." was cownon to each profile, but the actual year pf birth was 
different for each person. In Experiment 1 (Chap. II), subjects' 
memoiry for both the general form of a fact (e.g., someone was born in 
sorae^ year) and the details (e.g., the actual year of ^irth) improved 
by up to 100 percent when the text in which the fact appeared y^as 
preceded by one^ two^ or three different texts containing related' 
facts. Thus, presenting a series of ' related facts in well-learned 
structures is desirable because it facilitates memory for the related 
facts. ' 

2. Blocking presifentation of large numbers (on the order of 
five or more) of texts .containing related facts interferes with 
learning. 

Experiment 1 also showed that immediately preceding a text by 
five or more texts containing related faicts further improved memory 
for the general forms of related facts. However, memory for the 
details pf related facts '^deteriorated by up to 50 percent. This 
occurred because subjects had difficulty remembering, which detail 
(e.g., year of ^ birth) went 'with which text. Thus', blocking 
presentation of^ large numbers of texts containing related facts should 
be avoided because 'it interferes with memory for the details of 
related facts. , • ^ 

3. t Temporal 8eparat^.on in presentation of related texts can 
preserve facilitating effects and eliminate interfering effects. - 

Whenever related texts must be read, there is a good chance that 

memory for the information in the texts will suffer interference. For 

example, Experiment 1 showed that interference would occur if 
♦ 
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presentations of large numbers of -texts containing related facts were 
blocked.^ However, in £^xperinent 2, it was also found that 

interference effects could be elininated and memory » for details 

' • ' . »" 

specific to individual texts could be improved by up to 150 percent by 

i • • ■/ • _ 

inserting a reasonable temporal interval, such as 24 hours, between 
presentations of related texts. Thus, presentation * of potentially 
interfering related texts should be temporally separated to preclude 
interference effects and to facilitate memory for the details of 
studied texts. - , 

4. Elimination of redundancy and.- irrelevant coironentary from 
newspaper stories facilitates assimilation' and- retention of 
important facts. 

Newspaper stories ar.e written in accordance with stylistic 
conventions of journalism. The most timely, important, or 
eye-catc«ing information is placed in the opening sentences of a 
story, and the details and background information are elaborated in 
subsequent paragraphs. This organization results in distortions of 
the true narrative sequence of events, redundant repetition of facts, 
and commentary that is tangential to and less important' than the 

s 

•newsworthy events. In Experiments 3 and 4 (Chap. Ill), newspaper 
stories were restructured by grouping related' information together 
either in a sequential narrative or by primary topic, and by. 
eliminating redundant or unimportant ihformation. .Retention of 
important infbrmation was facilitated by a-ll reorganizations of news 
story facts that deleted the irrelevant information. In addition, the' 
redundant and unimpoVtant information was rarely recalled from the 
news stories. This indicates that when redundant and irrelevant 
information is present in stories/ it is rarely learned by readers and 
it inhibits acquisition of more salient facts. 

5. Text organizations tjiSt place complementary facts in close 
p roximity improve integration of those facts > ' 

Frequently, texts contain complementary information. The 
complementarity between separately occurring facts permits them to be 
integral:ed into a single, compo^site fact. For example, o(ie fact might 
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specify that George Washington was the first President of the United 
States and another might specify that he lived at Mount Vernon. It Is 
important for the reader to integrate these facts in order to realize 
that the first President qf the United States lived at Mount Vernon. 
In Experiments 5 and 6 (Chap. IV), presenting complementary facts in 
succession within a text^ rather than separating them with other 
related facts, improved performance by up to. 100 percentf^ Thus, text 
organizations that^maxim.ize the proximity of complementary facts are 
desirable because they facilitate integration of those facts, 

6 . . W ording complementary texts as similarly as possible 
improves integration of, complementary facts that occur in separate 
texts . ^ 

It is fr^(^uently impo^ible to organize^ texts so that 
complementary facts occur togettlfer or even in the .same text. A text 
may contain information that complements information from a prior 
text. For example, . the fact that George Washington was the first 
President of the United States might occur in an American History 
text, while the fact that he lived at Mount Vernon might occur in a 
biographical text. It is ^important for the reader to ' be able^ to 
integrate complementary facts even though they occur in separate 
texts. Experiments 5 and 6 showed that wording complementary facts 
that occur in separate texts as similarly as possible improved 
integration of the facts by up to 100 percent- Thus, it is desirable 
to word complementary texts as similarly as possible. , 

7 . Wotding related texts as similarly as possible improves 
inferential reasoning based on facts within' the texts. 

Sometimes, the information in a text is tangentially related to 
information that occurred in a previously learned text. While the 
relationship may not lead to simple integrati<ifh of related facts into 
a composite fact, it may provide a hasi& for inferential reasoning. 
For example, a text covering Early Americaq History might specify that 
George Washington was the first President of the United States. 
Another text covering Modern American History might specify that 
Franklin Delano Roosevelt was the first U.S.^ President to serve more 
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than two terms ot offi<ie. Using these two facts, the reader could 
infer that George Washington served no more than two terms of office. 
Experiment 7 (Chap. IV) showed that similar wording of tangentially 
related texts occurring in separate texts improved inferential 
reasoning based on those facts by up to 50 percent. Thus, delated 
texts should be worded as similarly as possible to facilitate 
inferential reasoning based on the infojfliation in the texts. 

8. Reasoning from memory of carefully studied texts is ibore 
acc urate th^n reasoning based on inspection of less familiar texts. 

People frequently have at their disposal a number of documents 

that provide the information on which decisions are to be based. A. 
♦ 

standard procedure is to use such documents as reference sources, 
searching them for 'particular facts or categories of information as 
they are needed. Experiment 8 (Chap. V) indicates that this is an 
effective strategy only if the infonrt*tion needed is present in 
literal form in the available documents. It is an ineffective 
I strategy if the information needed is available only as an inference 
based on a configuration of facts that occur separately in the 
documents. In the latter case, people p'erfprm poorly at obtaining 
necessary information. However, their performance can be improved by 
at least 50 percent if they study to learn the reference documents 
before attempting to use them*. Thus, having the reader study 
reference texts is desirable because it facilitates the ability to 
detect important relationships among separately occurring facts. 

9 • Stud ying to learn texts imp roves^know ledge of the 
informati on the texts contain over using the texts Xo perform 
inferencing. ^ 

As discussed above, people frequently fail to detect important 
relationships among facts if they have not first studied the documents 
in which the facts occur. In addition. Experiment 8 showed that 
people learn very little* about information contained in a text unless 
they consciously try to learn. For example, although people spend a 
considerable amount of time inspecting available texts in .their 
(usually unsuccessful) attempts to retrieve related facts, they learn 
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almost nothing. In contrast, people learn a great deal if they spend 
a comparable amount of time studying the available texts with the 
intention of learning the>^nforaation they contain. ThUs^ the reader 
ought to stiidy reference texts^ot only to facilitate detection of 
configurations of related facts, but also^ to facilitate future 
retrieval of individual facts « . ^ ^, > 

10. Annotating texts with references to related facts that 
have occurred in previous texts facilitates general- ir^ferential 
reasoning from the texts. . \ . 

Experiments 5 to 7, discussed above, indicated that > people have 
difficulty integrating complementary facts and drawing inferences from 
related facts in separate texts. However,, It is not always possibXe 
to organize texts so that complementary ^and related facts « occur 
together. In Experiment 9, a relatively simple annotation method was 
f(xund to improve inferential reajsoning based on facts occurring in 
separate , texts by up to 100 percent. This annotation method involved 
repeating previously read, related facts as footnotes to ^ the 
appropriate facts in a text. It was neither necessary nor desi^rable 
to generate the appropriate inference for the reader and*^include it in 
the footnote. This annotation method did not improve performance on 
inferences drawn from the annotated facts. However, it appeared to. 
'inhibit generation of other inferences, in addition to those leased on 
the annotated facts. Thus, texts should 'be annotated with references 
to prior, related facts in order to facilitate reasoning from the 
texts. » 
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